Nov 05 11:46:38 devstack cinder-volume[76037]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 11:46:38 devstack cinder-volume[76037]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:46:38 devstack cinder-volume[76037]: we strongly recommend against using it for new projects.
Nov 05 11:46:38 devstack cinder-volume[76037]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:46:38 devstack cinder-volume[76037]: framework.  For more detail see
Nov 05 11:46:38 devstack cinder-volume[76037]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:46:38 devstack cinder-volume[76037]:   import eventlet  # noqa
Nov 05 11:46:40 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:46:40 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:46:40 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:46:41 devstack cinder-volume[76037]: INFO dbcounter [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Registered counter for database cinder
Nov 05 11:46:41 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:42 devstack cinder-volume[76037]: DEBUG dbcounter [-] [76037] Writer thread running {{(pid=76037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:46:42 devstack cinder-volume[76037]: INFO cinder.rpc [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 11:46:42 devstack cinder-volume[76037]: INFO cinder.rpc [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 11:46:42 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:42 devstack cinder-volume[76037]: INFO cinder.volume.manager [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Determined volume DB was empty at startup.
Nov 05 11:46:42 devstack cinder-volume[76037]: DEBUG cinder.volume.manager [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76037) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 11:46:42 devstack cinder-volume[76037]: INFO cinder.volume.manager [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 11:46:42 devstack cinder-volume[76037]: WARNING stevedore.named [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:46:42 devstack cinder-volume[76037]: WARNING castellan.key_manager [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:46:42 devstack cinder-volume[76037]: WARNING cinder.keymgr.conf_key_mgr [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:46:42 devstack cinder-volume[76037]: DEBUG cinder.volume.drivers.lvm [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76037) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 11:46:42 devstack cinder-volume[76037]: DEBUG oslo_concurrency.processutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:42 devstack cinder-volume[76037]: DEBUG oslo_concurrency.processutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] CMD "cinder-rtstool verify" returned: 0 in 0.492s {{(pid=76037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:43 devstack cinder-volume[76037]: INFO cinder.rpc [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 11:46:43 devstack cinder-volume[76037]: INFO cinder.rpc [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 05 11:46:43 devstack cinder-volume[76037]: WARNING stevedore.named [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:46:43 devstack cinder-volume[76037]: WARNING castellan.key_manager [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:46:43 devstack cinder-volume[76037]: INFO cinder.volume.manager [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:43 devstack cinder-volume[76037]: INFO oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Starting 1 workers
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Started child 76201 {{(pid=76037) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Full set of CONF: {{(pid=76037) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] ******************************************************************************** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Configuration options gathered from: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] ================================================================================ {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] allow_availability_zone_fallback = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] allow_compression_on_image_upload = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] allowed_direct_url_schemes     = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76201]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] api_rate_limit                 = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] auth_strategy                  = keystone {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] az_cache_duration              = 3600 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_availability_zone      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_host                   = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_name                   = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_stats_polling_interval = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backup_api_class               = cinder.backup.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backup_name_template           = backup-%s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backup_use_same_host           = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backup_use_temp_snapshot       = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] chap_password                  = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] chap_username                  =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_internal_tenant_project_id = 50f4bf9f5f5542ffafc4358fefbac932 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_internal_tenant_user_id = 4b6b7defef8c4e8f9562c2ac9c95ad26 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cloned_volume_same_az          = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cluster                        = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] compression_format             = gzip {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] compute_api_class              = cinder.compute.nova.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] config_dir                     = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] config_source                  = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] control_exchange               = openstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] debug                          = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] default_availability_zone      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] default_group_type             = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] default_volume_type            = lvmdriver-1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] disk_geometry                  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] driver_client_cert             = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] driver_client_cert_key         = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] driver_data_namespace          = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] driver_ssl_cert_path           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] driver_ssl_cert_verify         = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] driver_use_ssl                 = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] enable_force_upload            = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] enable_new_services            = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] enable_unsupported_driver      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] enforce_multipath_for_image_xfer = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] filter_function                = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_api_insecure            = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_api_servers             = ['http://192.168.122.105/image'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_api_ssl_compression     = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_ca_certificates_file    = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76201]: INFO cinder.volume.manager [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_catalog_info            = image:glance:publicURL {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_certfile                = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_keyfile                 = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_num_retries             = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance_request_timeout         = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] goodness_function              = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] graceful_shutdown_timeout      = 5 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] group_api_class                = cinder.group.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] host                           = devstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_compress_on_upload       = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_conversion_address_space_limit = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_conversion_cpu_limit     = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_conversion_disable       = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_introspection_address_space_limit = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_introspection_cpu_limit  = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_upload_use_cinder_backend = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_upload_use_internal_tenant = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_volume_cache_enabled     = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_volume_cache_max_count   = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] image_volume_cache_max_size_gb = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] init_host_max_objects_retrieval = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] instance_format                = [instance: %(uuid)s]  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] iscsi_target_flags             =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] iscsi_write_cache              = on {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] iser_helper                    = tgtadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] iser_ip_address                = 192.168.122.105 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] iser_port                      = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_color                      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_config_append              = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_dir                        = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_file                       = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_options                    = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_rotate_interval            = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_rotate_interval_type       = days {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] log_rotation_type              = none {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] max_age                        = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] max_logfile_count              = 30 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] max_logfile_size_mb            = 200 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] max_over_subscription_ratio    = 20.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] message_reap_interval          = 86400 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] message_ttl                    = 2592000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] migration_create_volume_timeout_secs = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] monkey_patch                   = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] monkey_patch_modules           = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] my_ip                          = 192.168.122.105 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] no_snapshot_gb_quota           = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] num_iser_scan_tries            = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] num_shell_tries                = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] num_volume_device_scan_tries   = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] nvmeof_conn_info_version       = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] nvmet_ns_id                    = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] nvmet_port_id                  = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] osapi_max_limit                = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] osapi_volume_ext_list          = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] osapi_volume_listen_port       = 8776 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] osapi_volume_use_ssl           = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] osapi_volume_workers           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] per_volume_size_limit          = -1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] periodic_fuzzy_delay           = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] periodic_interval              = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] public_endpoint                = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] publish_errors                 = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] quota_backup_gigabytes         = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] quota_backups                  = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] quota_gigabytes                = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] quota_groups                   = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] quota_snapshots                = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] quota_volumes                  = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] rate_limit_burst               = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] rate_limit_except_level        = CRITICAL {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] rate_limit_interval            = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] reinit_driver_count            = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] replication_device             = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] report_discard_supported       = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] report_interval                = 120 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] reservation_clean_interval     = 86400 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] reservation_expire             = 86400 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] reserved_image_namespaces      = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] reserved_percentage            = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] rpc_response_timeout           = 120 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] run_external_periodic_tasks    = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] scst_target_driver             = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] scst_target_iqn_name           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_down_time              = 720 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] shell_completion               = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] snapshot_name_template         = snapshot-%s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] snapshot_same_host             = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] split_loggers                  = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] state_path                     = /opt/stack/data/cinder {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] storage_availability_zone      = nova {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] storage_protocol               = iSCSI {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] syslog_log_facility            = LOG_USER {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] target_helper                  = lioadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] target_ip_address              = 192.168.122.105 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] target_port                    = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] target_protocol                = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] target_secondary_ip_addresses  = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] trace_flags                    = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] transport_url                  = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] until_refresh                  = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] use_chap_auth                  = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] use_default_quota_class        = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] use_journal                    = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] use_json                       = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] use_multipath_for_image_xfer   = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] use_stderr                     = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] use_syslog                     = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] verify_glance_signatures       = enabled {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_api_class               = cinder.volume.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_backend_name            = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_clear                   = zero {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_clear_ionice            = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_clear_size              = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_copy_bps_limit          = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_dd_blocksize            = 1M {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_name_template           = volume-%s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_service_inithost_offload = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volume_usage_audit_period      = month {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] zoning_mode                    = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_concurrency.disable_process_locking = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.auth_section = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.auth_type   = password {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.auth_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.cache       = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.certfile    = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.delay_auth_decision = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.http_connect_timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.include_service_catalog = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.insecure    = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.interface   = public {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.keyfile     = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_password = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack sudo[76205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 11:46:43 devstack sudo[76205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcache_username = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.region_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.service_token_roles_required = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.service_type = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.token_cache_time = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.backend                  = dogpile.cache.null {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.backend_argument         = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.backend_expiration_time  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.config_prefix            = cache.oslo {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.debug_cache_backend      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.enable_retry_client      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.enable_socket_keepalive  = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.enabled                  = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.expiration_time          = 600 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.hashclient_retry_attempts = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.memcache_dead_retry      = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.memcache_pool_maxsize    = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.memcache_sasl_enabled    = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.password                 = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.proxies                  = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.redis_db                 = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.redis_sentinel_service_name = mymaster {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.redis_server             = localhost:6379 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.retry_attempts           = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.retry_delay              = 0.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.socket_keepalive_count   = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.socket_keepalive_idle    = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.socket_keepalive_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.socket_timeout           = 1.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.tls_allowed_ciphers      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.tls_cafile               = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.tls_certfile             = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.tls_enabled              = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.tls_keyfile              = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cache.username                 = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] coordination.backend_url       = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.asyncio_connection    = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.asyncio_slave_connection = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.backend               = sqlalchemy {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.connection            = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.connection_debug      = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.connection_parameters =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.connection_recycle_time = 3600 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.connection_trace      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.db_inc_retry_interval = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.db_max_retries        = 20 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.db_max_retry_interval = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.db_retry_interval     = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.max_overflow          = 50 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.max_pool_size         = 5 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.max_retries           = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.mysql_wsrep_sync_wait = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.pool_timeout          = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.retry_interval        = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.slave_connection      = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.sqlite_synchronous    = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.synchronous_reader    = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] database.use_db_reconnect      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_tracing.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.connection_string     = messaging:// {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.enabled               = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.es_doc_type           = notification {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.es_scroll_size        = 10000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.es_scroll_time        = 2m {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.filter_error_trace    = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.hmac_keys             = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.sentinel_service_name = mymaster {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.socket_timeout        = 0.1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.trace_requests        = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler.trace_sqlalchemy      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler_jaeger.process_tags   = {} {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler_jaeger.service_name_prefix = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] profiler_otlp.service_name_prefix = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.enforce_new_defaults = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.policy_default_rule = default {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.policy_file        = policy.yaml {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] privsep_osbrick.group          = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] privsep_osbrick.helper_command = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] privsep_osbrick.user           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_sys_admin.group         = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_sys_admin.helper_command = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] cinder_sys_admin.user          = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.auth_section      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.auth_type         = password {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.cafile            = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.certfile          = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.collect_timing    = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.insecure          = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.keyfile           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.send_service_user_token = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.split_loggers     = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.timeout           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.tls_ciphers       = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] service_user.tls_min_version   = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.auth_section            = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.auth_type               = password {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.certfile                = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.collect_timing          = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.insecure                = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.keyfile                 = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.region_name             = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.split_loggers           = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.timeout                 = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.tls_ciphers             = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] glance.tls_min_version         = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.backend_availability_zone = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.chap_password = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.chap_username =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.disk_geometry = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.driver_client_cert = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.driver_client_cert_key = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.driver_data_namespace = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.driver_use_ssl = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.enable_unsupported_driver = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.extra_capabilities = {} {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.filter_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.goodness_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.iscsi_target_flags =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.iscsi_write_cache = on {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.iser_helper   = tgtadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.iser_port     = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.lvm_share_target = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.lvm_type      = auto {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.num_shell_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.nvmet_port_id = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.replication_device = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.report_discard_supported = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.reserved_percentage = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.scst_target_driver = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.scst_target_iqn_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.storage_protocol = iSCSI {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.target_helper = tgtadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.target_port   = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.target_protocol = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.trace_flags   = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.unique_fqdn_network = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.use_chap_auth = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_backend_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_clear  = zero {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_clear_ionice = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_clear_size = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_reports.file_event_handler = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_reports.log_dir           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.backend_availability_zone = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.backend_host       = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.chap_password      = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.chap_username      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.disk_geometry      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.driver_client_cert = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.driver_data_namespace = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.extra_capabilities = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.filter_function    = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.goodness_function  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.iser_helper        = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.iser_ip_address    = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.iser_port          = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.iser_target_prefix = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.lvm_share_target   = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.lvm_type           = auto {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.num_shell_tries    = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.replication_device = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.report_discard_supported = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.reserved_percentage = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.scst_target_driver = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.storage_protocol   = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.target_helper      = lioadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.target_ip_address  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.target_port        = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.trace_flags        = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.use_chap_auth      = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_clear       = zero {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_clear_size  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] lvmdriver-1.volumes_dir        = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.ssl      = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_notifications.driver = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_notifications.retry = -1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] oslo_messaging_notifications.transport_url = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] key_manager.fixed_key          = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.barbican_api_version  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.barbican_endpoint     = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.barbican_endpoint_type = public {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.barbican_region_name  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.cafile                = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.certfile              = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.collect_timing        = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.insecure              = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.keyfile               = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.number_of_retries     = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.retry_delay           = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.send_service_user_token = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.split_loggers         = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.timeout               = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.tls_ciphers           = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.tls_min_version       = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.verify_ssl            = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican.verify_ssl_path       = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.auth_section = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.auth_type = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.cafile   = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.collect_timing = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.keyfile  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.split_loggers = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.timeout  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.tls_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] barbican_service_user.tls_min_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.approle_role_id          = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.approle_secret_id        = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.auth_method              = approle {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.auth_path                = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.kv_mountpoint            = secret {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.kv_path                  = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.kv_version               = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.namespace                = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.root_token_id            = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.ssl_ca_crt_file          = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.timeout                  = 60.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.token_file               = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.token_role               = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.use_ssl                  = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:46:43 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] ******************************************************************************** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 11:46:43 devstack sudo[76205]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.369s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:43 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:43 devstack sudo[76212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:43 devstack sudo[76212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:44 devstack sudo[76212]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.386s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 11:46:44 devstack cinder-volume[76201]: INFO cinder.brick.local_dev.lvm [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:44 devstack sudo[76368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:44 devstack sudo[76368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:44 devstack sudo[76368]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG cinder.brick.local_dev.lvm [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76201) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 11:46:44 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:44 devstack sudo[76457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:44 devstack sudo[76457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:45 devstack sudo[76457]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.569s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:45 devstack sudo[76677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:45 devstack sudo[76677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:45 devstack sudo[76677]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:45 devstack sudo[76811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 11:46:45 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:45 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.343s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:45 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:45 devstack sudo[76821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:45 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:46 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:46 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.375s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack sudo[76906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:46 devstack sudo[76906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:46 devstack sudo[76906]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:46 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack sudo[76909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:46 devstack sudo[76909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:46 devstack sudo[76909]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:46 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:46 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:46 devstack sudo[76951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:46 devstack sudo[76951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:47 devstack sudo[76951]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:47 devstack sudo[77002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:47 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:47 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:47 devstack cinder-volume[76201]: INFO cinder.volume.drivers.lvm [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:47 devstack sudo[77006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:47 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:47 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG cinder.volume.drivers.lvm [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Updating volume stats {{(pid=76201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:46:47 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:47 devstack sudo[77015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:47 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:48 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:48 devstack sudo[77018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:48 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:48 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:48 devstack sudo[77021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:48 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:48 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:48 devstack sudo[77024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:48 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:48 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:48 devstack cinder-volume[76201]: INFO cinder.volume.driver [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 11:46:48 devstack cinder-volume[76201]: DEBUG cinder.volume.driver [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76201) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG oslo_db.sqlalchemy.engines [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76201) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG dbcounter [-] [76201] Writer thread running {{(pid=76201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG cinder.db.api [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Building query based on filter {{(pid=76201) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG cinder.image.image_utils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76201) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 11:46:49 devstack cinder-volume[76201]: INFO cinder.keymgr.migration [None req-dd9b8f95-360d-4122-8252-e66357894903 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG cinder.volume.drivers.lvm [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Updating volume stats {{(pid=76201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:49 devstack sudo[77027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:49 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:49 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:49 devstack sudo[77032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:49 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:49 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:49 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:49 devstack sudo[77070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:49 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:50 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.340s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack sudo[77073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:50 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:50 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG cinder.manager [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Notifying Schedulers of capabilities ... {{(pid=76201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:46:50 devstack cinder-volume[76201]: INFO cinder.volume.manager [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Driver initialization completed successfully.
Nov 05 11:46:50 devstack cinder-volume[76201]: INFO cinder.manager [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Initiating service 2 cleanup
Nov 05 11:46:50 devstack cinder-volume[76201]: INFO cinder.manager [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Service 2 cleanup completed.
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG cinder.service [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Creating RPC server for service cinder-volume {{(pid=76201) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG cinder.service [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76201) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 11:46:50 devstack cinder-volume[76201]: INFO cinder.volume.manager [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG cinder.volume.drivers.lvm [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Updating volume stats {{(pid=76201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:46:50 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:50 devstack sudo[77079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:46:50 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:51 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:51 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:51 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:51 devstack sudo[77084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:51 devstack sudo[77084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:51 devstack sudo[77084]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:51 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:51 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:51 devstack sudo[77090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:46:51 devstack sudo[77090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:51 devstack sudo[77090]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:51 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:51 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:46:51 devstack sudo[77093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:46:51 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:46:52 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root
Nov 05 11:46:52 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:46:52 devstack cinder-volume[76201]: INFO cinder.volume.manager [None req-cca4b351-ccc4-4b67-b3e2-727599aa7d2d None None] Driver post RPC initialization completed successfully.
Nov 05 11:46:53 devstack cinder-volume[76037]: DEBUG dbcounter [-] [76037] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:47:00 devstack cinder-volume[76201]: DEBUG dbcounter [-] [76201] Writing DB stats cinder:SELECT=2 {{(pid=76201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:47:01 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager._thread_info {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:47:01 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread count: 6 {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:47:01 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread info: [<_MainThread(MainThread, started 135630291800192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135630178900928)>, <Thread(Thread-3 (stat_writer), started daemon 135630178752512)>, <Thread(Rabbit-heartbeat, started daemon 135630175955520)>, <Thread(Thread-5 (_runner), started daemon 135630176818752)>, <Thread(Thread-7 (_runner), started daemon 135630174848064)>] {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:47:02 devstack cinder-volume[76201]: DEBUG dbcounter [-] [76201] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG cinder.volume.drivers.lvm [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Updating volume stats {{(pid=76201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:01 devstack sudo[79341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:48:01 devstack sudo[79341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:01 devstack sudo[79341]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:01 devstack sudo[79360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:48:01 devstack sudo[79360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:01 devstack sudo[79360]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:01 devstack sudo[79363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:48:01 devstack sudo[79363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:01 devstack sudo[79363]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:48:01 devstack sudo[79366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:48:01 devstack sudo[79366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:48:02 devstack sudo[79366]: pam_unix(sudo:session): session closed for user root
Nov 05 11:48:02 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:48:02 devstack cinder-volume[76201]: DEBUG cinder.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Notifying Schedulers of capabilities ... {{(pid=76201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:48:02 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager._thread_info {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:48:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread count: 6 {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:48:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread info: [<_MainThread(MainThread, started 135630291800192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135630178900928)>, <Thread(Thread-3 (stat_writer), started daemon 135630178752512)>, <Thread(Rabbit-heartbeat, started daemon 135630175955520)>, <Thread(Thread-5 (_runner), started daemon 135630176818752)>, <Thread(Thread-7 (_runner), started daemon 135630174848064)>] {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG cinder.volume.drivers.lvm [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Updating volume stats {{(pid=76201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:01 devstack sudo[82452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:49:01 devstack sudo[82452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:01 devstack sudo[82452]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:01 devstack sudo[82460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:49:01 devstack sudo[82460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:01 devstack sudo[82460]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:01 devstack sudo[82463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:49:01 devstack sudo[82463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:01 devstack sudo[82463]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:49:01 devstack sudo[82466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:49:01 devstack sudo[82466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:49:02 devstack cinder-volume[76201]: DEBUG dbcounter [-] [76201] Writing DB stats cinder:SELECT=1 {{(pid=76201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:49:02 devstack cinder-volume[76201]: DEBUG dbcounter [-] [76201] Writing DB stats cinder:UPDATE=1 {{(pid=76201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:49:02 devstack sudo[82466]: pam_unix(sudo:session): session closed for user root
Nov 05 11:49:02 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:49:02 devstack cinder-volume[76201]: DEBUG cinder.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Notifying Schedulers of capabilities ... {{(pid=76201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:49:02 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager._thread_info {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:49:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread count: 6 {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:49:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread info: [<_MainThread(MainThread, started 135630291800192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135630178900928)>, <Thread(Thread-3 (stat_writer), started daemon 135630178752512)>, <Thread(Rabbit-heartbeat, started daemon 135630175955520)>, <Thread(Thread-5 (_runner), started daemon 135630176818752)>, <Thread(Thread-7 (_runner), started daemon 135630174848064)>] {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG cinder.volume.drivers.lvm [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Updating volume stats {{(pid=76201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:01 devstack sudo[84566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:50:01 devstack sudo[84566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:01 devstack sudo[84566]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:01 devstack sudo[84578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:50:01 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:01 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:01 devstack sudo[84596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:50:01 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:01 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:50:01 devstack sudo[84600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:50:01 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:50:02 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root
Nov 05 11:50:02 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:50:02 devstack cinder-volume[76201]: DEBUG cinder.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Notifying Schedulers of capabilities ... {{(pid=76201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:50:02 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager._thread_info {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:50:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread count: 6 {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:50:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread info: [<_MainThread(MainThread, started 135630291800192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135630178900928)>, <Thread(Thread-3 (stat_writer), started daemon 135630178752512)>, <Thread(Rabbit-heartbeat, started daemon 135630175955520)>, <Thread(Thread-5 (_runner), started daemon 135630176818752)>, <Thread(Thread-7 (_runner), started daemon 135630174848064)>] {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG cinder.volume.drivers.lvm [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Updating volume stats {{(pid=76201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:01 devstack sudo[85787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 11:51:01 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:01 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:01 devstack sudo[85790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:51:01 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:01 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:01 devstack sudo[85794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 11:51:01 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:01 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:01 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:01 devstack sudo[85797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 11:51:01 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:02 devstack cinder-volume[76201]: DEBUG dbcounter [-] [76201] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:51:02 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:02 devstack cinder-volume[76201]: DEBUG oslo_concurrency.processutils [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:02 devstack cinder-volume[76201]: DEBUG cinder.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Notifying Schedulers of capabilities ... {{(pid=76201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:51:02 devstack cinder-volume[76201]: DEBUG oslo_service.periodic_task [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] Running periodic task VolumeManager._thread_info {{(pid=76201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:51:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread count: 6 {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:51:02 devstack cinder-volume[76201]: DEBUG cinder.volume.manager [None req-036e9d52-3372-4e9f-96fd-d3c7422ea609 None None] thread info: [<_MainThread(MainThread, started 135630291800192)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135630178900928)>, <Thread(Thread-3 (stat_writer), started daemon 135630178752512)>, <Thread(Rabbit-heartbeat, started daemon 135630175955520)>, <Thread(Thread-5 (_runner), started daemon 135630176818752)>, <Thread(Thread-7 (_runner), started daemon 135630174848064)>] {{(pid=76201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:51:19 devstack cinder-volume[76037]: INFO oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Caught SIGTERM, stopping children
Nov 05 11:51:19 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Acquiring lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:19 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Acquired lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:19 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Releasing lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:19 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Stop services. {{(pid=76037) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 11:51:19 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Killing children. {{(pid=76037) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 11:51:19 devstack cinder-volume[76037]: INFO oslo_service.backend._eventlet.service [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Waiting on 1 children to exit
Nov 05 11:51:24 devstack cinder-volume[76201]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Nov 05 11:51:25 devstack cinder-volume[86286]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 11:51:25 devstack cinder-volume[86286]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:51:25 devstack cinder-volume[86286]: we strongly recommend against using it for new projects.
Nov 05 11:51:25 devstack cinder-volume[86286]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:51:25 devstack cinder-volume[86286]: framework.  For more detail see
Nov 05 11:51:25 devstack cinder-volume[86286]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:51:25 devstack cinder-volume[86286]:   import eventlet  # noqa
Nov 05 11:51:25 devstack cinder-volume[76201]: DEBUG oslo_concurrency.lockutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Acquiring lock "singleton_lock" {{(pid=76201) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:25 devstack cinder-volume[76201]: DEBUG oslo_concurrency.lockutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Acquired lock "singleton_lock" {{(pid=76201) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:25 devstack cinder-volume[76201]: DEBUG oslo_concurrency.lockutils [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Releasing lock "singleton_lock" {{(pid=76201) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:25 devstack cinder-volume[76201]: WARNING amqp [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:25 devstack cinder-volume[76201]: WARNING amqp [None req-a3f07865-ded5-4293-b037-b83b620c75ac None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:27 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:27 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:27 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:28 devstack cinder-volume[86286]: INFO dbcounter [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Registered counter for database cinder
Nov 05 11:51:28 devstack cinder-volume[86286]: DEBUG oslo_db.sqlalchemy.engines [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:28 devstack cinder-volume[86286]: DEBUG dbcounter [-] [86286] Writer thread running {{(pid=86286) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:28 devstack cinder-volume[86286]: INFO cinder.rpc [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 11:51:28 devstack cinder-volume[86286]: INFO cinder.rpc [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 11:51:28 devstack cinder-volume[86286]: DEBUG oslo_db.sqlalchemy.engines [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:28 devstack cinder-volume[86286]: INFO cinder.volume.manager [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Determined volume DB was empty at startup.
Nov 05 11:51:28 devstack cinder-volume[86286]: DEBUG cinder.volume.manager [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86286) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 11:51:28 devstack cinder-volume[86286]: INFO cinder.volume.manager [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 11:51:28 devstack cinder-volume[86286]: WARNING stevedore.named [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:51:28 devstack cinder-volume[86286]: WARNING castellan.key_manager [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:28 devstack cinder-volume[86286]: WARNING cinder.keymgr.conf_key_mgr [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:28 devstack cinder-volume[86286]: INFO cinder.volume.manager [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_db.sqlalchemy.engines [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:29 devstack cinder-volume[86286]: INFO oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Starting 1 workers
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Started child 86541 {{(pid=86286) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Full set of CONF: {{(pid=86286) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] ******************************************************************************** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Configuration options gathered from: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] ================================================================================ {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] allow_availability_zone_fallback = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] allow_compression_on_image_upload = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] allowed_direct_url_schemes     = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] api_rate_limit                 = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] auth_strategy                  = keystone {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_availability_zone      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_host                   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_name                   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_stats_polling_interval = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backup_api_class               = cinder.backup.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86541]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backup_name_template           = backup-%s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backup_use_same_host           = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backup_use_temp_snapshot       = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] chap_password                  = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] chap_username                  =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_internal_tenant_project_id = 50f4bf9f5f5542ffafc4358fefbac932 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_internal_tenant_user_id = 4b6b7defef8c4e8f9562c2ac9c95ad26 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cluster                        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] compression_format             = gzip {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] config_dir                     = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] config_source                  = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] control_exchange               = openstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] debug                          = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] default_availability_zone      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] default_group_type             = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] default_volume_type            = QuobyteHD {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] disk_geometry                  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] driver_client_cert             = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] driver_client_cert_key         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] driver_data_namespace          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] driver_ssl_cert_path           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] driver_ssl_cert_verify         = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] driver_use_ssl                 = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] enable_new_services            = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] enable_unsupported_driver      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] enforce_multipath_for_image_xfer = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] filter_function                = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_api_insecure            = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_api_servers             = ['http://192.168.122.105/image'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_api_ssl_compression     = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_ca_certificates_file    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_certfile                = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_keyfile                 = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_num_retries             = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance_request_timeout         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] goodness_function              = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] graceful_shutdown_timeout      = 5 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] group_api_class                = cinder.group.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] host                           = devstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_compress_on_upload       = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_conversion_address_space_limit = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_conversion_cpu_limit     = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_conversion_disable       = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_introspection_address_space_limit = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_introspection_cpu_limit  = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_upload_use_cinder_backend = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_upload_use_internal_tenant = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_volume_cache_enabled     = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_volume_cache_max_count   = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] image_volume_cache_max_size_gb = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] init_host_max_objects_retrieval = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] iscsi_target_flags             =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] iscsi_write_cache              = on {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] iser_helper                    = tgtadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] iser_ip_address                = 192.168.122.105 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] iser_port                      = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_color                      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_config_append              = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_dir                        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_file                       = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_options                    = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_rotate_interval            = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_rotate_interval_type       = days {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] log_rotation_type              = none {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] max_age                        = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] max_logfile_count              = 30 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] max_logfile_size_mb            = 200 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] max_over_subscription_ratio    = 20.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] message_reap_interval          = 86400 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] message_ttl                    = 2592000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] migration_create_volume_timeout_secs = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] monkey_patch                   = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] monkey_patch_modules           = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] my_ip                          = 192.168.122.105 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] no_snapshot_gb_quota           = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] num_iser_scan_tries            = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] num_shell_tries                = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] num_volume_device_scan_tries   = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] nvmeof_conn_info_version       = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] nvmet_ns_id                    = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] nvmet_port_id                  = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] osapi_max_limit                = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] osapi_volume_ext_list          = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] osapi_volume_listen_port       = 8776 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] osapi_volume_use_ssl           = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] osapi_volume_workers           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] per_volume_size_limit          = -1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] periodic_fuzzy_delay           = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] periodic_interval              = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] public_endpoint                = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] publish_errors                 = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] quota_backup_gigabytes         = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] quota_backups                  = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] quota_gigabytes                = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] quota_groups                   = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] quota_snapshots                = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] quota_volumes                  = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] rate_limit_burst               = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] rate_limit_except_level        = CRITICAL {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] rate_limit_interval            = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] reinit_driver_count            = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.remotefs [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86541) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] replication_device             = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] report_discard_supported       = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] report_interval                = 120 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] reservation_clean_interval     = 86400 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] reservation_expire             = 86400 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] reserved_image_namespaces      = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] reserved_percentage            = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] rpc_response_timeout           = 120 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] run_external_periodic_tasks    = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] scst_target_driver             = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] scst_target_iqn_name           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_down_time              = 720 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] shell_completion               = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] snapshot_name_template         = snapshot-%s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] split_loggers                  = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] state_path                     = /opt/stack/data/cinder {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] storage_availability_zone      = nova {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] storage_protocol               = iSCSI {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] syslog_log_facility            = LOG_USER {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] target_helper                  = lioadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] target_ip_address              = 192.168.122.105 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] target_port                    = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] target_protocol                = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] target_secondary_ip_addresses  = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] trace_flags                    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] transport_url                  = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] until_refresh                  = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] use_chap_auth                  = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] use_default_quota_class        = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] use_journal                    = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] use_json                       = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] use_multipath_for_image_xfer   = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] use_stderr                     = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] use_syslog                     = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] verify_glance_signatures       = enabled {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_api_class               = cinder.volume.api.API {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_backend_name            = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_clear                   = zero {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_clear_ionice            = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_clear_size              = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_copy_bps_limit          = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_dd_blocksize            = 1M {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_name_template           = volume-%s {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_service_inithost_offload = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volume_usage_audit_period      = month {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] zoning_mode                    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_concurrency.disable_process_locking = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.auth_section = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.auth_type   = password {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.auth_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.cache       = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.certfile    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.include_service_catalog = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.insecure    = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.interface   = public {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.keyfile     = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcache_username = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.region_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.service_type = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.backend                  = dogpile.cache.null {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.backend_argument         = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.backend_expiration_time  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.config_prefix            = cache.oslo {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.debug_cache_backend      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.enable_retry_client      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.enable_socket_keepalive  = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.enabled                  = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.expiration_time          = 600 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.hashclient_retry_attempts = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.memcache_dead_retry      = 300 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.memcache_sasl_enabled    = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.password                 = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.proxies                  = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.redis_db                 = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.redis_server             = localhost:6379 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.retry_attempts           = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.retry_delay              = 0.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.socket_keepalive_count   = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.socket_keepalive_idle    = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.socket_keepalive_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.socket_timeout           = 1.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.tls_allowed_ciphers      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.tls_cafile               = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.tls_certfile             = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.tls_enabled              = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.tls_keyfile              = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cache.username                 = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] coordination.backend_url       = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.asyncio_connection    = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.asyncio_slave_connection = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.backend               = sqlalchemy {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.connection            = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.connection_debug      = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.connection_parameters =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.connection_recycle_time = 3600 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.connection_trace      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.db_inc_retry_interval = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.db_max_retries        = 20 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.db_max_retry_interval = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.db_retry_interval     = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.max_overflow          = 50 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.max_pool_size         = 5 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.max_retries           = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.mysql_wsrep_sync_wait = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.pool_timeout          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.retry_interval        = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.slave_connection      = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.sqlite_synchronous    = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.synchronous_reader    = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] database.use_db_reconnect      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_tracing.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.connection_string     = messaging:// {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.enabled               = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.es_doc_type           = notification {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.es_scroll_size        = 10000 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.es_scroll_time        = 2m {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.filter_error_trace    = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.hmac_keys             = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.sentinel_service_name = mymaster {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.socket_timeout        = 0.1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.trace_requests        = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler.trace_sqlalchemy      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler_jaeger.process_tags   = {} {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler_jaeger.service_name_prefix = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] profiler_otlp.service_name_prefix = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.enforce_new_defaults = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.policy_default_rule = default {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] privsep_osbrick.group          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] privsep_osbrick.helper_command = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] privsep_osbrick.user           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_sys_admin.group         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_sys_admin.helper_command = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] cinder_sys_admin.user          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.auth_section      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.auth_type         = password {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.cafile            = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.certfile          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.collect_timing    = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.insecure          = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.keyfile           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.send_service_user_token = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.split_loggers     = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.timeout           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.tls_ciphers       = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] service_user.tls_min_version   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.auth_section            = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.auth_type               = password {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.certfile                = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.collect_timing          = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.insecure                = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.keyfile                 = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.region_name             = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.split_loggers           = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.timeout                 = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.tls_ciphers             = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] glance.tls_min_version         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.backend_availability_zone = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.chap_password = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.chap_username =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.disk_geometry = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.driver_client_cert = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.driver_client_cert_key = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.driver_data_namespace = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.driver_use_ssl = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.extra_capabilities = {} {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.filter_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.goodness_function = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.iscsi_target_flags =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.iscsi_write_cache = on {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.iser_port     = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86541) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 11:51:29 devstack cinder-volume[86541]: WARNING cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_host      =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_login     = admin {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_mount_options = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_password  = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_private_key =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_share_path =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: WARNING cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.num_shell_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.quobyte_volume_url = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.replication_device = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.report_discard_supported = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.reserved_percentage = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.target_helper = tgtadm {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.target_port   = 3260 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.target_protocol = iscsi {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.trace_flags   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.unique_fqdn_network = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.use_chap_auth = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_backend_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_clear  = zero {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_clear_ionice = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_clear_size = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_reports.file_event_handler = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_reports.log_dir           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.backend_availability_zone = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.backend_host         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.chap_password        = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.chap_username        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.disk_geometry        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.driver_client_cert   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.driver_data_namespace = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.extra_capabilities   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.filter_function      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.goodness_function    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.iser_helper          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.iser_ip_address      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.iser_port            = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_host             = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_login            = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_mount_options    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_password         = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_private_key      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_share_path       = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.num_shell_tries      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.replication_device   = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.report_discard_supported = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.reserved_percentage  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.scst_target_driver   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.storage_protocol     = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.target_helper        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.target_ip_address    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.target_port          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.target_prefix        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.target_protocol      = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.trace_flags          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.use_chap_auth        = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_clear         = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_clear_size    = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] QuobyteHD.volumes_dir          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack quobyte-client[86548]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 11:51:29 devstack quobyte-client[86548]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_notifications.driver = [] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_notifications.retry = -1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] key_manager.fixed_key          = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: INFO cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff ...
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.barbican_api_version  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 -c /etc/quobyte/client-cinder.cfg {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.barbican_endpoint     = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.barbican_endpoint_type = public {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.barbican_region_name  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.cafile                = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.certfile              = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.collect_timing        = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.insecure              = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.keyfile               = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.number_of_retries     = 60 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.retry_delay           = 1 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.send_service_user_token = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.split_loggers         = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.timeout               = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.tls_ciphers           = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.tls_min_version       = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.verify_ssl            = True {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican.verify_ssl_path       = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.auth_section = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.auth_type = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.cafile   = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.certfile = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.collect_timing = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.insecure = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.keyfile  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.split_loggers = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.timeout  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.tls_ciphers = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] barbican_service_user.tls_min_version = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.approle_role_id          = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.approle_secret_id        = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.auth_method              = approle {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.auth_path                = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.kv_mountpoint            = secret {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.kv_path                  = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.kv_version               = 2 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.namespace                = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.root_token_id            = **** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.ssl_ca_crt_file          = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.timeout                  = 60.0 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.token_file               = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.token_role               = None {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.use_ssl                  = False {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack sudo[86549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 -c /etc/quobyte/client-cinder.cfg
Nov 05 11:51:29 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:29 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] ******************************************************************************** {{(pid=86286) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 11:51:29 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.480s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:29 devstack cinder-volume[86541]: INFO cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff succeeded
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.499s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:29 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:29 devstack sudo[86659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:51:29 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:30 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.256s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:30 devstack cinder-volume[86541]: INFO cinder.volume.driver [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.volume.driver [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4731140136719, 'free_capacity_gb': 1773.4731140136719, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86541) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG dbcounter [-] [86541] Writer thread running {{(pid=86541) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.db.api [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Building query based on filter {{(pid=86541) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.image.image_utils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86541) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 11:51:30 devstack cinder-volume[86541]: INFO cinder.keymgr.migration [None req-cb47af94-23c3-4003-85ea-0a4c3e71d050 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:30 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:51:30 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:30 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.263s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.manager [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Notifying Schedulers of capabilities ... {{(pid=86541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:51:30 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Driver initialization completed successfully.
Nov 05 11:51:30 devstack cinder-volume[86541]: INFO cinder.manager [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Initiating service 3 cleanup
Nov 05 11:51:30 devstack cinder-volume[86541]: INFO cinder.manager [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Service 3 cleanup completed.
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.service [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Creating RPC server for service cinder-volume {{(pid=86541) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.service [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86541) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 11:51:30 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:30 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:30 devstack sudo[86674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:51:30 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:31 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:31 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.254s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:31 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-e0a70c72-1fc1-45cf-bb45-e8076c640eb2 None None] Driver post RPC initialization completed successfully.
Nov 05 11:51:35 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:35 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:35 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=86541) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:35 devstack cinder-volume[86541]: DEBUG cinder.volume.drivers.quobyte [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=86541) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:35 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86541) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:35 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:35 devstack cinder-volume[86286]: INFO oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Caught SIGTERM, stopping children
Nov 05 11:51:35 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Acquiring lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:35 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Acquired lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:35 devstack cinder-volume[86286]: DEBUG oslo_concurrency.lockutils [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Releasing lock "singleton_lock" {{(pid=86286) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:35 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Stop services. {{(pid=86286) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 11:51:35 devstack cinder-volume[86286]: DEBUG oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Killing children. {{(pid=86286) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 11:51:35 devstack cinder-volume[86286]: INFO oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Waiting on 1 children to exit
Nov 05 11:51:35 devstack sudo[86945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:51:35 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:36 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:36 devstack cinder-volume[86541]: DEBUG oslo_concurrency.processutils [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.678s {{(pid=86541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:36 devstack cinder-volume[86541]: DEBUG cinder.manager [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Notifying Schedulers of capabilities ... {{(pid=86541) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Unable to connect to AMQP server on 192.168.122.105:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server [None req-f62c3b9c-18ea-4a03-897d-6a7eb1794a1a None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.105:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     method()
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return _publish(
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     listener(*args)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server 
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server 
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self.transport._send(
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.105:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 11:51:36 devstack cinder-volume[86541]: ERROR oslo_messaging.rpc.server 
Nov 05 11:51:39 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Acquiring lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:39 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Acquired lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:39 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Releasing lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:39 devstack cinder-volume[86541]: WARNING amqp [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:39 devstack cinder-volume[86541]: WARNING amqp [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 11:51:39 devstack cinder-volume[86286]: INFO oslo_service.backend._eventlet.service [None req-efaf4d2a-c1ce-410f-8596-f46b0a09bd78 None None] Child 86541 exited with status 0
Nov 05 11:51:39 devstack cinder-volume[87004]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 11:51:39 devstack cinder-volume[87004]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:51:39 devstack cinder-volume[87004]: we strongly recommend against using it for new projects.
Nov 05 11:51:39 devstack cinder-volume[87004]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:51:39 devstack cinder-volume[87004]: framework.  For more detail see
Nov 05 11:51:39 devstack cinder-volume[87004]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:51:39 devstack cinder-volume[87004]:   import eventlet  # noqa
Nov 05 11:51:43 devstack cinder-volume[87004]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 11:51:43 devstack cinder-volume[87004]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 11:51:43 devstack cinder-volume[87004]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 11:51:44 devstack cinder-volume[87004]: INFO dbcounter [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Registered counter for database cinder
Nov 05 11:51:44 devstack cinder-volume[87004]: DEBUG oslo_db.sqlalchemy.engines [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG dbcounter [-] [87004] Writer thread running {{(pid=87004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:45 devstack cinder-volume[87004]: INFO cinder.rpc [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 11:51:45 devstack cinder-volume[87004]: INFO cinder.rpc [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_db.sqlalchemy.engines [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:45 devstack cinder-volume[87004]: INFO cinder.volume.manager [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Determined volume DB was empty at startup.
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG cinder.volume.manager [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87004) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 11:51:45 devstack cinder-volume[87004]: WARNING stevedore.named [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 11:51:45 devstack cinder-volume[87004]: WARNING castellan.key_manager [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:45 devstack cinder-volume[87004]: WARNING cinder.keymgr.conf_key_mgr [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 11:51:45 devstack cinder-volume[87004]: INFO cinder.volume.manager [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_db.sqlalchemy.engines [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:45 devstack cinder-volume[87004]: INFO oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Starting 1 workers
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Started child 87317 {{(pid=87004) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Full set of CONF: {{(pid=87004) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] ******************************************************************************** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] Configuration options gathered from: {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] ================================================================================ {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 11:51:45 devstack cinder-volume[87317]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] allow_availability_zone_fallback = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] allow_compression_on_image_upload = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] allowed_direct_url_schemes     = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] api_rate_limit                 = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] auth_strategy                  = keystone {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_availability_zone      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_host                   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_name                   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_stats_polling_interval = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backup_api_class               = cinder.backup.api.API {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backup_name_template           = backup-%s {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backup_use_same_host           = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backup_use_temp_snapshot       = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] chap_password                  = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] chap_username                  =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_internal_tenant_project_id = 50f4bf9f5f5542ffafc4358fefbac932 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_internal_tenant_user_id = 4b6b7defef8c4e8f9562c2ac9c95ad26 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cluster                        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] compression_format             = gzip {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] compute_api_class              = cinder.compute.nova.API {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] config_dir                     = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] config_source                  = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] control_exchange               = openstack {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] debug                          = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] default_availability_zone      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] default_group_type             = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] default_volume_type            = QuobyteHD {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] disk_geometry                  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] driver_client_cert             = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] driver_client_cert_key         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] driver_data_namespace          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] driver_ssl_cert_path           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] driver_ssl_cert_verify         = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] driver_use_ssl                 = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] enable_new_services            = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] enable_unsupported_driver      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] enabled_backends               = ['QuobyteHD'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] enforce_multipath_for_image_xfer = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] filter_function                = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_api_insecure            = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_api_servers             = ['http://192.168.122.105/image'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_api_ssl_compression     = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_ca_certificates_file    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_catalog_info            = image:glance:publicURL {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_certfile                = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_keyfile                 = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_num_retries             = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance_request_timeout         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] goodness_function              = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] graceful_shutdown_timeout      = 5 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] group_api_class                = cinder.group.api.API {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] host                           = devstack {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_compress_on_upload       = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_conversion_address_space_limit = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_conversion_cpu_limit     = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_conversion_disable       = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_introspection_address_space_limit = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_introspection_cpu_limit  = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_upload_use_cinder_backend = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_upload_use_internal_tenant = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_volume_cache_enabled     = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_volume_cache_max_count   = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] image_volume_cache_max_size_gb = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] init_host_max_objects_retrieval = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] instance_format                = [instance: %(uuid)s]  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] iscsi_target_flags             =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87317) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] iscsi_write_cache              = on {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] iser_helper                    = tgtadm {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] iser_ip_address                = 192.168.122.105 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] iser_port                      = 3260 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_color                      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_config_append              = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_dir                        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_file                       = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_options                    = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_rotate_interval            = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_rotate_interval_type       = days {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] log_rotation_type              = none {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] max_age                        = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] max_logfile_count              = 30 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] max_logfile_size_mb            = 200 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] max_over_subscription_ratio    = 20.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] message_reap_interval          = 86400 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] message_ttl                    = 2592000 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] migration_create_volume_timeout_secs = 300 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] monkey_patch                   = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] monkey_patch_modules           = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] my_ip                          = 192.168.122.105 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] no_snapshot_gb_quota           = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] num_iser_scan_tries            = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] num_shell_tries                = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] num_volume_device_scan_tries   = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] nvmeof_conn_info_version       = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] nvmet_ns_id                    = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] nvmet_port_id                  = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] osapi_max_limit                = 1000 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] osapi_volume_ext_list          = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] osapi_volume_listen_port       = 8776 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] osapi_volume_use_ssl           = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] osapi_volume_workers           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] per_volume_size_limit          = -1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] periodic_fuzzy_delay           = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] periodic_interval              = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] public_endpoint                = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] publish_errors                 = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] quota_backup_gigabytes         = 1000 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] quota_backups                  = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] quota_gigabytes                = 1000 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] quota_groups                   = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] quota_snapshots                = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] quota_volumes                  = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] rate_limit_burst               = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] rate_limit_except_level        = CRITICAL {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] rate_limit_interval            = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] reinit_driver_count            = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] replication_device             = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] report_discard_supported       = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] report_interval                = 120 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] reservation_clean_interval     = 86400 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] reservation_expire             = 86400 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] reserved_image_namespaces      = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] reserved_percentage            = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] rpc_response_timeout           = 120 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] run_external_periodic_tasks    = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] scst_target_driver             = iscsi {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] scst_target_iqn_name           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_down_time              = 720 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] shell_completion               = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] snapshot_name_template         = snapshot-%s {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] split_loggers                  = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] state_path                     = /opt/stack/data/cinder {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] storage_availability_zone      = nova {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] storage_protocol               = iSCSI {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] syslog_log_facility            = LOG_USER {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] target_helper                  = lioadm {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] target_ip_address              = 192.168.122.105 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] target_port                    = 3260 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] target_protocol                = iscsi {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] target_secondary_ip_addresses  = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] trace_flags                    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] transport_url                  = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] until_refresh                  = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] use_chap_auth                  = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] use_default_quota_class        = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] use_journal                    = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] use_json                       = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] use_multipath_for_image_xfer   = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] use_stderr                     = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] use_syslog                     = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] verify_glance_signatures       = enabled {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_api_class               = cinder.volume.api.API {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_backend_name            = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_clear                   = zero {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_clear_ionice            = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_clear_size              = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_copy_bps_limit          = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_dd_blocksize            = 1M {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_name_template           = volume-%s {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_service_inithost_offload = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volume_usage_audit_period      = month {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] zoning_mode                    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_concurrency.disable_process_locking = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.auth_section = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.auth_type   = password {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.auth_version = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.cache       = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.certfile    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.delay_auth_decision = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.http_connect_timeout = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.include_service_catalog = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.insecure    = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.interface   = public {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.keyfile     = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_password = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87317) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcache_username = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.region_name = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Running cmd (subprocess): mount.quobyte {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.service_token_roles_required = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.service_type = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.token_cache_time = 300 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.backend                  = dogpile.cache.null {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.backend_argument         = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.backend_expiration_time  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.config_prefix            = cache.oslo {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.debug_cache_backend      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.enable_retry_client      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.enable_socket_keepalive  = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.enabled                  = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.expiration_time          = 600 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.hashclient_retry_attempts = 2 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.memcache_dead_retry      = 300 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.memcache_pool_maxsize    = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.memcache_sasl_enabled    = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.password                 = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.proxies                  = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.redis_db                 = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.redis_sentinel_service_name = mymaster {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.redis_server             = localhost:6379 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.retry_attempts           = 2 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.retry_delay              = 0.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.socket_keepalive_count   = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.socket_keepalive_idle    = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.socket_keepalive_interval = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.socket_timeout           = 1.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.tls_allowed_ciphers      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.tls_cafile               = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.tls_certfile             = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.tls_enabled              = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.tls_keyfile              = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cache.username                 = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] coordination.backend_url       = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.asyncio_connection    = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.asyncio_slave_connection = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.backend               = sqlalchemy {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.connection            = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.connection_debug      = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.connection_parameters =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.connection_recycle_time = 3600 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.connection_trace      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.db_inc_retry_interval = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.db_max_retries        = 20 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.db_max_retry_interval = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.db_retry_interval     = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.max_overflow          = 50 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.max_pool_size         = 5 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.max_retries           = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.mysql_wsrep_sync_wait = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.pool_timeout          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.retry_interval        = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.slave_connection      = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.sqlite_synchronous    = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.synchronous_reader    = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] database.use_db_reconnect      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_tracing.insecure = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.connection_string     = messaging:// {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.enabled               = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.es_doc_type           = notification {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.es_scroll_size        = 10000 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.es_scroll_time        = 2m {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.filter_error_trace    = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.hmac_keys             = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.sentinel_service_name = mymaster {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.socket_timeout        = 0.1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.trace_requests        = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler.trace_sqlalchemy      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler_jaeger.process_tags   = {} {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler_jaeger.service_name_prefix = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] profiler_otlp.service_name_prefix = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.enforce_new_defaults = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.policy_default_rule = default {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.policy_file        = policy.yaml {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] privsep_osbrick.group          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] privsep_osbrick.helper_command = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] privsep_osbrick.user           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_sys_admin.group         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_sys_admin.helper_command = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] cinder_sys_admin.user          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.auth_section      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.auth_type         = password {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.cafile            = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.certfile          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.collect_timing    = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.insecure          = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.keyfile           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.send_service_user_token = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.split_loggers     = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.timeout           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.tls_ciphers       = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] service_user.tls_min_version   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.auth_section            = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.auth_type               = password {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.certfile                = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.collect_timing          = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.insecure                = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.keyfile                 = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.region_name             = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.split_loggers           = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.timeout                 = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.tls_ciphers             = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] glance.tls_min_version         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.backend_availability_zone = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.chap_password = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.chap_username =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.disk_geometry = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.driver_client_cert = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.driver_client_cert_key = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.driver_data_namespace = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.driver_use_ssl = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.enable_unsupported_driver = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.extra_capabilities = {} {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.filter_function = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.goodness_function = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack quobyte-client[87318]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.iscsi_target_flags =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.iscsi_write_cache = on {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack quobyte-client[87318]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.iser_helper   = tgtadm {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.iser_port     = 3260 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_host      =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_login     = admin {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_mount_options = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_password  = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_private_key =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_share_path =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.num_shell_tries = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.nvmet_port_id = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.quobyte_client_cfg = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.quobyte_volume_url = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.replication_device = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.report_discard_supported = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.reserved_percentage = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.scst_target_driver = iscsi {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.scst_target_iqn_name = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.storage_protocol = iSCSI {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.target_helper = tgtadm {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.target_port   = 3260 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.target_protocol = iscsi {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.trace_flags   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.unique_fqdn_network = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.use_chap_auth = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_backend_name = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_clear  = zero {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_clear_ionice = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_clear_size = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_reports.file_event_handler = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_reports.log_dir           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.backend_availability_zone = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.backend_host         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.chap_password        = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.chap_username        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.chiscsi_conf         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.disk_geometry        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.driver_client_cert   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.driver_client_cert_key = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.driver_data_namespace = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.driver_use_ssl       = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.extra_capabilities   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.filter_function      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.goodness_function    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.iser_helper          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.iser_ip_address      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.iser_port            = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.iser_target_prefix   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_host             = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_login            = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_mount_options    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_password         = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_private_key      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_share_path       = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_ssh_port         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.num_shell_tries      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.nvmet_port_id        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.replication_device   = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.report_discard_supported = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.reserved_percentage  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.scst_target_driver   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.storage_protocol     = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.target_helper        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.target_ip_address    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.target_port          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.target_prefix        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.target_protocol      = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.trace_flags          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.use_chap_auth        = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_clear         = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_clear_size    = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] QuobyteHD.volumes_dir          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.ssl      = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_notifications.driver = [] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_notifications.retry = -1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] oslo_messaging_notifications.transport_url = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] key_manager.fixed_key          = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.barbican_api_version  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.barbican_endpoint     = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.barbican_endpoint_type = public {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.barbican_region_name  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.cafile                = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.certfile              = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.collect_timing        = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.insecure              = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.keyfile               = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.number_of_retries     = 60 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.retry_delay           = 1 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.send_service_user_token = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.split_loggers         = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.timeout               = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.tls_ciphers           = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.tls_min_version       = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.verify_ssl            = True {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican.verify_ssl_path       = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.auth_section = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.auth_type = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.cafile   = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.certfile = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.collect_timing = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.insecure = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.keyfile  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.split_loggers = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.timeout  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.tls_ciphers = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] barbican_service_user.tls_min_version = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.approle_role_id          = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.approle_secret_id        = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.auth_method              = approle {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.auth_path                = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.kv_mountpoint            = secret {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.kv_path                  = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.kv_version               = 2 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.namespace                = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.root_token_id            = **** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.ssl_ca_crt_file          = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.timeout                  = 60.0 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.token_file               = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.token_role               = None {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.use_ssl                  = False {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 11:51:45 devstack cinder-volume[87004]: DEBUG oslo_service.backend._eventlet.service [None req-81ac528d-58e2-40a7-aa46-0bd53563e8af None None] ******************************************************************************** {{(pid=87004) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 11:51:45 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:45 devstack cinder-volume[87317]: INFO cinder.volume.driver [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.volume.driver [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4715194702148, 'free_capacity_gb': 1773.4715194702148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87317) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_db.sqlalchemy.engines [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87317) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writer thread running {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.db.api [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Building query based on filter {{(pid=87317) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87317) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:45 devstack cinder-volume[87317]: INFO cinder.keymgr.migration [None req-6ca5cea4-77f5-434b-bc13-06278a42bdf8 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 11:51:45 devstack sudo[87322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:51:45 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:46 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.256s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:51:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Driver initialization completed successfully.
Nov 05 11:51:46 devstack cinder-volume[87317]: INFO cinder.manager [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Initiating service 3 cleanup
Nov 05 11:51:46 devstack cinder-volume[87317]: INFO cinder.manager [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Service 3 cleanup completed.
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG cinder.service [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Creating RPC server for service cinder-volume {{(pid=87317) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG cinder.service [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87317) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 11:51:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:51:46 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:51:46 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:51:46 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Nov 05 11:51:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.258s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:51:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bec02810-5d74-4322-a508-70ae979e23f9 None None] Driver post RPC initialization completed successfully.
Nov 05 11:51:55 devstack cinder-volume[87004]: DEBUG dbcounter [-] [87004] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:51:56 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:51:56 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=2 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:52:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:52:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 6 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:52:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:52:44 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:52:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Flow 'volume_create_manager' (d06d3ce7-0839-45c3-88a9-05f91562d456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:52:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fc0213-8ca8-487e-b8e4-79e6c619f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fc0213-8ca8-487e-b8e4-79e6c619f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1310684996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed70a26f-37bc-4132-b3dc-1084aba438b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9926f7b264944619897665b2aefd5360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:52:45Z,use_quota=True,user_id='7591040597754e88b3eee9318ea89049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0703ed4-ad20-408b-87aa-988a0a386990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0703ed4-ad20-408b-87aa-988a0a386990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00f4925-2011-4b14-bd19-c194d1bf3c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00f4925-2011-4b14-bd19-c194d1bf3c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed70a26f-37bc-4132-b3dc-1084aba438b3', 'volume_name': 'volume-ed70a26f-37bc-4132-b3dc-1084aba438b3', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7aee01-a3e6-4101-8af1-fc383c06a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7aee01-a3e6-4101-8af1-fc383c06a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714fa48b-2742-49fc-9bcd-f39b9a5b073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:45 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Volume ed70a26f-37bc-4132-b3dc-1084aba438b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed70a26f-37bc-4132-b3dc-1084aba438b3', 'volume_size': 1}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1310684996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed70a26f-37bc-4132-b3dc-1084aba438b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9926f7b264944619897665b2aefd5360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:52:45Z,use_quota=True,user_id='7591040597754e88b3eee9318ea89049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Creating volume ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:52:45 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:45 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 1073741824
Nov 05 11:52:45 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:45 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 1073741824" returned: 0 in 0.759s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:45 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3
Nov 05 11:52:45 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:46 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3" returned: 0 in 0.329s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:52:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:52:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714fa48b-2742-49fc-9bcd-f39b9a5b073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed70a26f-37bc-4132-b3dc-1084aba438b3', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed76a11-190c-4330-a588-864469c20c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:46 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Volume volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 (ed70a26f-37bc-4132-b3dc-1084aba438b3): created successfully
Nov 05 11:52:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed76a11-190c-4330-a588-864469c20c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Flow 'volume_create_manager' (d06d3ce7-0839-45c3-88a9-05f91562d456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:52:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-45adacd6-3a4a-4182-b4c9-bc195864d395 req-ef79b45e-fea2-4541-93b8-175e63154e9e tempest-VolumesSnapshotsTestJSON-1939872897 None] Created volume successfully.
Nov 05 11:52:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:52:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:52:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Creating offline snapshot 0017d513-6e1c-4c92-93fa-23ef5732fdd6 of volume ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:52:47 devstack cinder-volume[87317]: INFO oslo.privsep.daemon [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp45n_qz7_/privsep.sock']
Nov 05 11:52:47 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp45n_qz7_/privsep.sock
Nov 05 11:52:47 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 11:52:49 devstack cinder-volume[87317]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 11:52:50 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:50 devstack cinder-volume[87317]: INFO oslo.privsep.daemon [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Spawned new privsep daemon via rootwrap
Nov 05 11:52:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Accepted privsep connection to /tmp/tmp45n_qz7_/privsep.sock {{(pid=87317) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 11:52:50 devstack cinder-volume[87317]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 11:52:50 devstack cinder-volume[87317]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 11:52:50 devstack cinder-volume[87317]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 11:52:50 devstack cinder-volume[87317]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87968
Nov 05 11:52:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4a7e8-445a-4e9c-bbdd-741125d90521]: (2,) {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:52:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae33a0-ad84-42c8-b57b-11dab61294f9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:52:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:50 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3
Nov 05 11:52:50 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:51 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3" returned: 0 in 0.849s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:51 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 1G
Nov 05 11:52:51 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:52 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 1G" returned: 0 in 1.103s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:52 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6
Nov 05 11:52:52 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:53 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6" returned: 0 in 0.678s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:53 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 is being set with open permissions: ugo+rw
Nov 05 11:52:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:53 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6
Nov 05 11:52:53 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:53 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6" returned: 0 in 0.553s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:53 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.info
Nov 05 11:52:53 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:54 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.info" returned: 0 in 0.436s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:54 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.info is being set with open permissions: ugo+rw
Nov 05 11:52:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:54 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.info
Nov 05 11:52:54 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:54 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.info" returned: 0 in 0.639s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.510s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:52:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-2b0c8a1e-4289-437e-ac61-5953dce635ba req-869c3d84-193b-4a0c-907c-1de32bfc61ec tempest-VolumesSnapshotsTestJSON-1939872897 None] Create snapshot completed successfully
Nov 05 11:52:55 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:52:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Flow 'volume_create_manager' (d0407613-1ff7-4783-9f24-272256f8e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:52:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b436c69c-7244-4000-96ae-a2f0f43e115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b436c69c-7244-4000-96ae-a2f0f43e115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1776130724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4713803-cff5-4169-a34c-7474ff18e810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed70db099ff4beb8d77a6edc674f0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:52:56Z,use_quota=True,user_id='7c6d83e0e99e4c37b78d03dc7c4f986c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deae4fb8-44f7-4aee-8416-c46baaeceb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deae4fb8-44f7-4aee-8416-c46baaeceb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591114f3-0824-4eea-b859-1e692f04840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591114f3-0824-4eea-b859-1e692f04840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4713803-cff5-4169-a34c-7474ff18e810', 'volume_name': 'volume-c4713803-cff5-4169-a34c-7474ff18e810', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a33ba2-a99f-4a28-8687-028f8b677cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a33ba2-a99f-4a28-8687-028f8b677cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b91c7c-485d-4a25-a18f-b94870dc189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Volume c4713803-cff5-4169-a34c-7474ff18e810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4713803-cff5-4169-a34c-7474ff18e810', 'volume_size': 1}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1776130724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4713803-cff5-4169-a34c-7474ff18e810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed70db099ff4beb8d77a6edc674f0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:52:56Z,use_quota=True,user_id='7c6d83e0e99e4c37b78d03dc7c4f986c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Creating volume c4713803-cff5-4169-a34c-7474ff18e810 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:52:56 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:56 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810 1073741824
Nov 05 11:52:56 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "cinder-0017d513-6e1c-4c92-93fa-23ef5732fdd6-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-0017d513-6e1c-4c92-93fa-23ef5732fdd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "cinder-quobyte-ed70a26f-37bc-4132-b3dc-1084aba438b3" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-quobyte-ed70a26f-37bc-4132-b3dc-1084aba438b3" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "cinder-quobyte-0017d513-6e1c-4c92-93fa-23ef5732fdd6" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-quobyte-0017d513-6e1c-4c92-93fa-23ef5732fdd6" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Deleting offline snapshot 0017d513-6e1c-4c92-93fa-23ef5732fdd6 of volume ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] snapshot_file for this snap is: volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d6da89-120a-4792-81a0-6e7614f0bb9e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:52:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:57 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810 1073741824" returned: 0 in 0.880s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:57 devstack sudo[88116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6
Nov 05 11:52:57 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:57 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810
Nov 05 11:52:57 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:58 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810" returned: 0 in 1.048s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b91c7c-485d-4a25-a18f-b94870dc189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4713803-cff5-4169-a34c-7474ff18e810', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec4bac9-c7d3-42cc-ac71-58f27c6522d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:52:58 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Volume volume-c4713803-cff5-4169-a34c-7474ff18e810 (c4713803-cff5-4169-a34c-7474ff18e810): created successfully
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec4bac9-c7d3-42cc-ac71-58f27c6522d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Flow 'volume_create_manager' (d0407613-1ff7-4783-9f24-272256f8e468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6" returned: 0 in 1.628s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed70a26f-37bc-4132-b3dc-1084aba438b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:52:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-14aef8f7-b7e1-4a8c-8c09-4f7a8ed0bed4 tempest-DeleteServersTestJSON-934426967 None] Created volume successfully.
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[84457154-3d63-4560-949f-20a1ef1f4a13]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:52:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:58 devstack sudo[88157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3
Nov 05 11:52:58 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:52:59 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root
Nov 05 11:52:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3" returned: 0 in 1.167s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:52:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:52:59 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6
Nov 05 11:52:59 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:00 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6" returned: 0 in 1.151s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:01 devstack sudo[88230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6
Nov 05 11:53:01 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:01 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3.0017d513-6e1c-4c92-93fa-23ef5732fdd6" returned: 0 in 0.755s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-quobyte-0017d513-6e1c-4c92-93fa-23ef5732fdd6" released by "_delete_snapshot" :: held 5.087s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-quobyte-ed70a26f-37bc-4132-b3dc-1084aba438b3" released by "delete_snapshot" :: held 5.186s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:01 devstack cinder-volume[87317]: WARNING cinder.quota [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:53:01 devstack cinder-volume[87317]: WARNING cinder.quota [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.quota [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Created reservations ['b4eb3490-53e2-4dc3-96a3-e351c6b687e3', '32262e88-8eae-4f37-816d-8dc338fc5a06', '922d61ef-ac63-457f-8609-ebc4f798919a', '275fcd7e-d007-4b4d-b010-f290eeca663f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Delete snapshot completed successfully.
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-14a1b96f-f98e-44f3-aabe-1d387e0c63cf req-f0dcadf1-b535-4017-9c5f-d62424cf63cd tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-0017d513-6e1c-4c92-93fa-23ef5732fdd6-delete_snapshot" released by "delete_snapshot" :: held 5.843s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Flow 'volume_create_manager' (02634b8a-8b05-475c-8b60-ada956710ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c63c819-6e2e-486c-8039-b4570ff009ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c63c819-6e2e-486c-8039-b4570ff009ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1031601058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9029c619-4593-4ea3-8700-b8e9ed59e353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7f984cfa8c4a0db1ec0b540a6fbc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:03Z,use_quota=True,user_id='c3412601403e412e94f8d615df73a04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae857b8-08f2-456e-bcb5-e6086028baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae857b8-08f2-456e-bcb5-e6086028baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f401586-9fe5-4163-8654-51ac6a884486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f401586-9fe5-4163-8654-51ac6a884486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9029c619-4593-4ea3-8700-b8e9ed59e353', 'volume_name': 'volume-9029c619-4593-4ea3-8700-b8e9ed59e353', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cf048a-89bb-43ff-9252-86adccc57d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cf048a-89bb-43ff-9252-86adccc57d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4024f48e-5b3f-401e-9259-54bb3cb5bd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:02 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Volume 9029c619-4593-4ea3-8700-b8e9ed59e353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9029c619-4593-4ea3-8700-b8e9ed59e353', 'volume_size': 1}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1031601058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9029c619-4593-4ea3-8700-b8e9ed59e353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7f984cfa8c4a0db1ec0b540a6fbc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:03Z,use_quota=True,user_id='c3412601403e412e94f8d615df73a04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Creating volume 9029c619-4593-4ea3-8700-b8e9ed59e353 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:02 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:53:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:02 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353 1073741824
Nov 05 11:53:02 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "cinder-ed70a26f-37bc-4132-b3dc-1084aba438b3-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-ed70a26f-37bc-4132-b3dc-1084aba438b3-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "cinder-quobyte-ed70a26f-37bc-4132-b3dc-1084aba438b3" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-quobyte-ed70a26f-37bc-4132-b3dc-1084aba438b3" acquired by "delete_volume" :: waited 0.043s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f20addd-6f16-41b2-9eba-b84537aed173]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:03 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353 1073741824" returned: 0 in 1.043s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:03 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3
Nov 05 11:53:03 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:03 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353
Nov 05 11:53:03 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:04 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3" returned: 0 in 0.826s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:04 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3
Nov 05 11:53:04 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:04 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353" returned: 0 in 0.855s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4024f48e-5b3f-401e-9259-54bb3cb5bd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9029c619-4593-4ea3-8700-b8e9ed59e353', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6e3b84-fb7a-4e67-9729-d2f2ac2b5c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:04 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Volume volume-9029c619-4593-4ea3-8700-b8e9ed59e353 (9029c619-4593-4ea3-8700-b8e9ed59e353): created successfully
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6e3b84-fb7a-4e67-9729-d2f2ac2b5c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Flow 'volume_create_manager' (02634b8a-8b05-475c-8b60-ada956710ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4232cc34-14f4-465a-9d01-dc7db6b67ecd tempest-VolumesAdminNegativeTest-30061458 None] Created volume successfully.
Nov 05 11:53:05 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ed70a26f-37bc-4132-b3dc-1084aba438b3" returned: 0 in 0.675s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-quobyte-ed70a26f-37bc-4132-b3dc-1084aba438b3" released by "delete_volume" :: held 1.685s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:05 devstack cinder-volume[87317]: WARNING cinder.quota [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG cinder.quota [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Created reservations ['2c58ded6-f603-4442-828c-84715c8c1769', 'bf08f3f6-917d-4d51-a168-546a58515f1b', '1487f8d2-e759-4c07-8ffb-de410b556670', '3a2bc97b-380b-46bb-a8b9-408969b64a7c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:05 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:05 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:05 devstack cinder-volume[87317]: WARNING py.warnings [req-f096939a-58bf-454e-b73b-f4aa478fcc54 req-c7d05334-18ee-47a3-a0b6-d7dc36f2419f tempest-DeleteServersTestJSON-934426967 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 05 11:53:05 devstack cinder-volume[87317]:   .first()
Nov 05 11:53:05 devstack cinder-volume[87317]: 
Nov 05 11:53:05 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.566s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:05 devstack cinder-volume[87317]: DEBUG cinder.manager [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f096939a-58bf-454e-b73b-f4aa478fcc54 req-c7d05334-18ee-47a3-a0b6-d7dc36f2419f tempest-DeleteServersTestJSON-934426967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f096939a-58bf-454e-b73b-f4aa478fcc54 req-c7d05334-18ee-47a3-a0b6-d7dc36f2419f tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Deleted volume successfully.
Nov 05 11:53:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f096939a-58bf-454e-b73b-f4aa478fcc54 req-c7d05334-18ee-47a3-a0b6-d7dc36f2419f tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.251s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-f096939a-58bf-454e-b73b-f4aa478fcc54 req-c7d05334-18ee-47a3-a0b6-d7dc36f2419f tempest-DeleteServersTestJSON-934426967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-c4713803-cff5-4169-a34c-7474ff18e810', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee04387c-1131-4452-ac85-fee4eddd7800', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:53:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-cc9cab6b-00d1-44e8-b7a1-35d465f03e61 req-d0b19e9b-e553-4de4-9264-8f7350dfb51e tempest-VolumesSnapshotsTestJSON-1939872897 None] Lock "cinder-ed70a26f-37bc-4132-b3dc-1084aba438b3-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-f096939a-58bf-454e-b73b-f4aa478fcc54 req-c7d05334-18ee-47a3-a0b6-d7dc36f2419f tempest-DeleteServersTestJSON-934426967 None] attachment_update completed successfully.
Nov 05 11:53:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Acquiring lock "cinder-9029c619-4593-4ea3-8700-b8e9ed59e353-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Lock "cinder-9029c619-4593-4ea3-8700-b8e9ed59e353-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Acquiring lock "cinder-quobyte-9029c619-4593-4ea3-8700-b8e9ed59e353" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Lock "cinder-quobyte-9029c619-4593-4ea3-8700-b8e9ed59e353" acquired by "delete_volume" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:08 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffb24a3-130c-4f61-a566-c1c9fc1aecc8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:08 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353
Nov 05 11:53:08 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:09 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353" returned: 0 in 0.853s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:09 devstack sudo[88750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353
Nov 05 11:53:09 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:09 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9029c619-4593-4ea3-8700-b8e9ed59e353" returned: 0 in 0.489s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Lock "cinder-quobyte-9029c619-4593-4ea3-8700-b8e9ed59e353" released by "delete_volume" :: held 1.451s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Created reservations ['6c2e4163-5968-400d-af23-6041ee56778b', '94cda52d-b062-4f31-85cf-5ba822389b72', 'bac3c28d-aca5-43c5-8ea2-48a6fac69085', 'faa55fd9-3405-4b4c-926f-9e431a4001e1'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:09 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:09 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:10 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.771s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:10 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:10 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Deleted volume successfully.
Nov 05 11:53:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e32e89fd-765e-4bc4-be6a-b1854a050bbf tempest-VolumesAdminNegativeTest-30061458 None] Lock "cinder-9029c619-4593-4ea3-8700-b8e9ed59e353-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:13 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:13 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:13 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-41784d76-5dc7-4a8a-b9b3-ed307df4e143 req-d31d4033-c352-437d-a214-1c16ce419c0b tempest-DeleteServersTestJSON-934426967 None] Terminate volume connection completed successfully.
Nov 05 11:53:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-41784d76-5dc7-4a8a-b9b3-ed307df4e143 req-d31d4033-c352-437d-a214-1c16ce419c0b tempest-DeleteServersTestJSON-934426967 None] Deleting attachment ee04387c-1131-4452-ac85-fee4eddd7800. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:53:14 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.521s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:53:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 8 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:53:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Flow 'volume_create_manager' (a0e3008e-a3b9-41f1-8d40-b595c2ac28ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1954ee8d-5203-49a4-b631-a52b82df9e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1954ee8d-5203-49a4-b631-a52b82df9e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-616614588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b912b5a-2bbb-4b62-8c04-49279cc1df94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72bd0e9b4a524510b84650a04396c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:15Z,use_quota=True,user_id='bb2220c39d514dffa6c637075d3d0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97f92fa-fd1b-413e-be52-3e6c8eed40de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97f92fa-fd1b-413e-be52-3e6c8eed40de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1db16d3-6b71-48d3-a6aa-498782205cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1db16d3-6b71-48d3-a6aa-498782205cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b912b5a-2bbb-4b62-8c04-49279cc1df94', 'volume_name': 'volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441214d5-e33b-486d-9be5-50a2cab01347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441214d5-e33b-486d-9be5-50a2cab01347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f41ca3-dc3b-4eca-bf60-841681a8c5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:15 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Volume 8b912b5a-2bbb-4b62-8c04-49279cc1df94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94', 'volume_size': 1}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-616614588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b912b5a-2bbb-4b62-8c04-49279cc1df94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72bd0e9b4a524510b84650a04396c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:15Z,use_quota=True,user_id='bb2220c39d514dffa6c637075d3d0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Creating volume 8b912b5a-2bbb-4b62-8c04-49279cc1df94 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:15 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Acquiring lock "cinder-c4713803-cff5-4169-a34c-7474ff18e810-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:15 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94 1073741824
Nov 05 11:53:15 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Lock "cinder-c4713803-cff5-4169-a34c-7474ff18e810-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Acquiring lock "cinder-quobyte-c4713803-cff5-4169-a34c-7474ff18e810" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Lock "cinder-quobyte-c4713803-cff5-4169-a34c-7474ff18e810" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd456df5-8139-4715-a3f6-7caaf2290850]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:15 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810
Nov 05 11:53:15 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:16 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94 1073741824" returned: 0 in 0.603s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:16 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810" returned: 0 in 0.463s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:16 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810
Nov 05 11:53:16 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:16 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94
Nov 05 11:53:16 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:16 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94" returned: 0 in 0.254s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:16 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f41ca3-dc3b-4eca-bf60-841681a8c5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c830e92-530d-4a7c-9b00-508394032832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4713803-cff5-4169-a34c-7474ff18e810" returned: 0 in 0.322s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Lock "cinder-quobyte-c4713803-cff5-4169-a34c-7474ff18e810" released by "delete_volume" :: held 0.849s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:16 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Volume volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94 (8b912b5a-2bbb-4b62-8c04-49279cc1df94): created successfully
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c830e92-530d-4a7c-9b00-508394032832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Flow 'volume_create_manager' (a0e3008e-a3b9-41f1-8d40-b595c2ac28ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:16 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9ee865b2-fb34-4fb1-9457-d8d747f93bc4 tempest-VolumesTestJSON-1734539093 None] Created volume successfully.
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Created reservations ['8000326f-20cf-4bca-a191-f7a7321f5545', 'b6ec9726-0ba1-48b3-9071-5820e53aac00', '887c1286-3dd7-4cc5-8632-0346a617947e', '669f5e56-77c0-4db2-b54c-9677548bab16'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:16 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:16 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:16 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.320s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:16 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Deleted volume successfully.
Nov 05 11:53:16 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-337ad975-2464-48f5-9654-298045e242bc tempest-DeleteServersTestJSON-934426967 None] Lock "cinder-c4713803-cff5-4169-a34c-7474ff18e810-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Flow 'volume_create_manager' (b393b6bb-c4dc-4faf-a755-1f1971b23c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aced4bfc-a294-4202-a69f-2e6072d310e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aced4bfc-a294-4202-a69f-2e6072d310e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-176521854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a9de71-bfc9-43b6-bfb6-4b734b65efd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72bd0e9b4a524510b84650a04396c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:18Z,use_quota=True,user_id='bb2220c39d514dffa6c637075d3d0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637c6d4f-277e-46ef-8296-830c4ba84fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637c6d4f-277e-46ef-8296-830c4ba84fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd014d14-2821-4af6-a1dc-a682026a8770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd014d14-2821-4af6-a1dc-a682026a8770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a9de71-bfc9-43b6-bfb6-4b734b65efd4', 'volume_name': 'volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1954ed9-b0d8-483b-b851-dbc641a625aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1954ed9-b0d8-483b-b851-dbc641a625aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8152ceae-5234-40fd-9819-36d5d4cdc2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:18 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Volume c4a9de71-bfc9-43b6-bfb6-4b734b65efd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4', 'volume_size': 1}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-176521854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a9de71-bfc9-43b6-bfb6-4b734b65efd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72bd0e9b4a524510b84650a04396c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:18Z,use_quota=True,user_id='bb2220c39d514dffa6c637075d3d0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Creating volume c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:18 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:18 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 1073741824
Nov 05 11:53:18 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:18 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 1073741824" returned: 0 in 0.543s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:18 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4
Nov 05 11:53:18 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:19 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4" returned: 0 in 0.312s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8152ceae-5234-40fd-9819-36d5d4cdc2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cd727d-e010-423d-9716-c273d50c9065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:19 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Volume volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 (c4a9de71-bfc9-43b6-bfb6-4b734b65efd4): created successfully
Nov 05 11:53:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cd727d-e010-423d-9716-c273d50c9065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Flow 'volume_create_manager' (b393b6bb-c4dc-4faf-a755-1f1971b23c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:19 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3e4abb64-8a65-4879-8045-26a896ee74c9 tempest-VolumesTestJSON-1734539093 None] Created volume successfully.
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Flow 'volume_create_manager' (b760adb6-b38f-4277-9a17-721fe24d991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4290f92a-2bb6-4aa9-bf3c-3496a9eafde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4290f92a-2bb6-4aa9-bf3c-3496a9eafde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581511646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14482f34-1f3f-4ef4-a50e-c5376652bc97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72bd0e9b4a524510b84650a04396c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:21Z,use_quota=True,user_id='bb2220c39d514dffa6c637075d3d0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20673ba-be93-41cf-8cf9-bff3285ce7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20673ba-be93-41cf-8cf9-bff3285ce7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d288d9d-91e6-4178-ac22-ec71b0fde562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d288d9d-91e6-4178-ac22-ec71b0fde562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14482f34-1f3f-4ef4-a50e-c5376652bc97', 'volume_name': 'volume-14482f34-1f3f-4ef4-a50e-c5376652bc97', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4545ce-71d4-43fb-9583-747321671992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4545ce-71d4-43fb-9583-747321671992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257fb479-39c5-4ffd-aada-bed6c3c0705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:21 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Volume 14482f34-1f3f-4ef4-a50e-c5376652bc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14482f34-1f3f-4ef4-a50e-c5376652bc97', 'volume_size': 1}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581511646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14482f34-1f3f-4ef4-a50e-c5376652bc97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72bd0e9b4a524510b84650a04396c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:21Z,use_quota=True,user_id='bb2220c39d514dffa6c637075d3d0a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Creating volume 14482f34-1f3f-4ef4-a50e-c5376652bc97 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:21 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:21 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97 1073741824
Nov 05 11:53:21 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:21 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97 1073741824" returned: 0 in 0.540s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:21 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97
Nov 05 11:53:21 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:22 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97" returned: 0 in 0.254s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257fb479-39c5-4ffd-aada-bed6c3c0705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14482f34-1f3f-4ef4-a50e-c5376652bc97', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f70661-ac89-4619-8893-498f9165beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:22 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Volume volume-14482f34-1f3f-4ef4-a50e-c5376652bc97 (14482f34-1f3f-4ef4-a50e-c5376652bc97): created successfully
Nov 05 11:53:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f70661-ac89-4619-8893-498f9165beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Flow 'volume_create_manager' (b760adb6-b38f-4277-9a17-721fe24d991e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:22 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-864a60f7-e7bb-4cc0-bbcb-d18f35bfb48e tempest-VolumesTestJSON-1734539093 None] Created volume successfully.
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Acquiring lock "cinder-14482f34-1f3f-4ef4-a50e-c5376652bc97-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Lock "cinder-14482f34-1f3f-4ef4-a50e-c5376652bc97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Acquiring lock "cinder-quobyte-14482f34-1f3f-4ef4-a50e-c5376652bc97" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Lock "cinder-quobyte-14482f34-1f3f-4ef4-a50e-c5376652bc97" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6baa7ba-59b8-466a-a79c-ec0e48ac999e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:24 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97
Nov 05 11:53:24 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:24 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97" returned: 0 in 0.475s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:24 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97
Nov 05 11:53:24 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:25 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14482f34-1f3f-4ef4-a50e-c5376652bc97" returned: 0 in 0.352s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Lock "cinder-quobyte-14482f34-1f3f-4ef4-a50e-c5376652bc97" released by "delete_volume" :: held 0.883s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Created reservations ['e505c7f4-44a0-4d7e-82b0-f816e918e3a2', '45bf1df5-6c32-4a12-8792-57221ca3d09b', 'f5ff6804-bdb7-4489-bb21-1bf0beb50a8b', '1678422a-d711-4dd0-afec-f8bfd5ee80c3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:25 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:25 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Acquiring lock "cinder-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Lock "cinder-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Acquiring lock "cinder-quobyte-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Lock "cinder-quobyte-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e3271-344d-41c9-80df-b27c67a4f298]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:25 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.360s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Deleted volume successfully.
Nov 05 11:53:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-98bb2f63-02ca-477e-aed4-2bbb15f48a0d tempest-VolumesTestJSON-1734539093 None] Lock "cinder-14482f34-1f3f-4ef4-a50e-c5376652bc97-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:25 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4
Nov 05 11:53:25 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:26 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4" returned: 0 in 0.661s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:26 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4
Nov 05 11:53:26 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:26 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4" returned: 0 in 0.330s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Lock "cinder-quobyte-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4" released by "delete_volume" :: held 1.085s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Created reservations ['470869e4-5cfd-4292-be93-e036aae31f8f', 'd7977d6a-4779-4879-942a-98680bf2f72b', 'f65f7c96-008b-40d5-973b-df222face083', '5d7f3881-8843-4d2b-a8b6-1305ed5eadef'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:26 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:26 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:27 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.346s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:27 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Deleted volume successfully.
Nov 05 11:53:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d1b46a49-fe21-4289-bf01-b0d365d0d5cb tempest-VolumesTestJSON-1734539093 None] Lock "cinder-c4a9de71-bfc9-43b6-bfb6-4b734b65efd4-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Acquiring lock "cinder-8b912b5a-2bbb-4b62-8c04-49279cc1df94-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Lock "cinder-8b912b5a-2bbb-4b62-8c04-49279cc1df94-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Acquiring lock "cinder-quobyte-8b912b5a-2bbb-4b62-8c04-49279cc1df94" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Lock "cinder-quobyte-8b912b5a-2bbb-4b62-8c04-49279cc1df94" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5406334c-a172-4972-98b9-2828568fe58c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:28 devstack sudo[88914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94
Nov 05 11:53:28 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:28 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94" returned: 0 in 0.457s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:28 devstack sudo[88920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94
Nov 05 11:53:28 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:28 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8b912b5a-2bbb-4b62-8c04-49279cc1df94" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Lock "cinder-quobyte-8b912b5a-2bbb-4b62-8c04-49279cc1df94" released by "delete_volume" :: held 0.798s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:28 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Created reservations ['763c65ba-e79a-4d08-93f1-d43f21b2454a', '08b44260-0eb9-4fc7-8713-805e6e8bb347', 'c3396ecb-9407-438a-a47c-16f9ad5f83ba', 'a1fe5bc2-deee-4db9-b8c6-77999a8fcd88'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:29 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:29 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:29 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.377s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:29 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Deleted volume successfully.
Nov 05 11:53:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d589629-d839-4254-b3d5-33f620c3adfe tempest-VolumesTestJSON-1734539093 None] Lock "cinder-8b912b5a-2bbb-4b62-8c04-49279cc1df94-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0d3641af-7f9a-4c16-bf3f-246ed1f731b8 tempest-BackendsCapabilitiesAdminTestsJSON-1304670654 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4715194702148, 'free_capacity_gb': 1773.4715194702148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87317) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 11:53:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a6a32609-62db-4ff9-a43d-c6067fa49571 tempest-BackendsCapabilitiesAdminTestsJSON-1304670654 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4715194702148, 'free_capacity_gb': 1773.4715194702148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87317) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 11:53:39 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=78,cinder:SELECT=54,cinder:DELETE=7,cinder:INSERT=22 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:53:39 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=63,cinder:INSERT=13,cinder:UPDATE=71,cinder:DELETE=6 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Flow 'volume_create_manager' (a0034883-8f94-4a8c-a9a7-b505d704798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55169e7-d7d0-4a00-b9dc-9bab132a9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55169e7-d7d0-4a00-b9dc-9bab132a9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-597631899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96069502f5614ab5a13377b5dd1c6935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:55Z,use_quota=True,user_id='daf7da787c344524be5323f6453545f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9475841a-9c85-4839-860a-0bd4f483b3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9475841a-9c85-4839-860a-0bd4f483b3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee072c32-8c20-4b2e-a620-012b5ba9275a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee072c32-8c20-4b2e-a620-012b5ba9275a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf', 'volume_name': 'volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded80ec0-93fa-4a0d-be26-d36d2521576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded80ec0-93fa-4a0d-be26-d36d2521576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31c08f5-784f-4b05-b399-1ed7b8275251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Volume ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf', 'volume_size': 1}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-597631899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96069502f5614ab5a13377b5dd1c6935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:53:55Z,use_quota=True,user_id='daf7da787c344524be5323f6453545f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Creating volume ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:53:54 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:53:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:55 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf 1073741824
Nov 05 11:53:55 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:55 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf 1073741824" returned: 0 in 0.658s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:55 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf
Nov 05 11:53:55 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:56 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf" returned: 0 in 0.373s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:53:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31c08f5-784f-4b05-b399-1ed7b8275251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a7fbd2-854e-43ae-9d0e-93ed86ade29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:53:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Volume volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf (ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf): created successfully
Nov 05 11:53:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a7fbd2-854e-43ae-9d0e-93ed86ade29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:53:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Flow 'volume_create_manager' (a0034883-8f94-4a8c-a9a7-b505d704798a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:53:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-42843133-5964-4c54-9c6f-2dc0b72d21a9 tempest-VolumeQuotasAdminTestJSON-132422726 None] Created volume successfully.
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Acquiring lock "cinder-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "cinder-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Acquiring lock "cinder-quobyte-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "cinder-quobyte-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00887a0-3d55-4b57-8f71-069917350cff]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:57 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf
Nov 05 11:53:57 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:57 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf" returned: 0 in 0.550s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:57 devstack sudo[89120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf
Nov 05 11:53:57 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:58 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf" returned: 0 in 0.405s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "cinder-quobyte-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf" released by "delete_volume" :: held 1.059s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Created reservations ['3a5458a6-fe1a-4827-8ec8-a3393ab21d36', 'e2931c99-9528-4738-bd0e-e95a5d667f1d', '97d8ff89-5a65-4914-8a65-a01157e0db94', '0966d20f-2905-4996-b10d-943afcf2fcab'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:53:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:53:58 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:53:58 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:53:59 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Nov 05 11:53:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.441s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:53:59 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:53:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Deleted volume successfully.
Nov 05 11:53:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a168b7c9-83c7-4742-8ddb-cf6bc58759c2 tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "cinder-ab1aa130-bedc-4eaf-84c9-f0d0cf8a36bf-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Flow 'volume_create_manager' (ff286def-d3be-430c-832d-ddb7d76d4526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcdc191-74d7-4131-b6d7-b38bae93fdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcdc191-74d7-4131-b6d7-b38bae93fdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1475723783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8c79e4-159d-497c-b6ef-4308483a5c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96069502f5614ab5a13377b5dd1c6935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:01Z,use_quota=True,user_id='daf7da787c344524be5323f6453545f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a726b9-a115-49a1-9f41-79561fd224b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a726b9-a115-49a1-9f41-79561fd224b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a99a3d1-c28c-449c-9119-b9d8e9fbd49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a99a3d1-c28c-449c-9119-b9d8e9fbd49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b8c79e4-159d-497c-b6ef-4308483a5c7b', 'volume_name': 'volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354ec54e-0fab-4172-b64a-270f9b89723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354ec54e-0fab-4172-b64a-270f9b89723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0019e2e-995f-4fd3-b0d3-1195903c6fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:00 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Volume 9b8c79e4-159d-497c-b6ef-4308483a5c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b', 'volume_size': 1}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1475723783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8c79e4-159d-497c-b6ef-4308483a5c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96069502f5614ab5a13377b5dd1c6935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:01Z,use_quota=True,user_id='daf7da787c344524be5323f6453545f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Creating volume 9b8c79e4-159d-497c-b6ef-4308483a5c7b {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:54:00 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:54:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:00 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b 1073741824
Nov 05 11:54:00 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:01 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b 1073741824" returned: 0 in 0.688s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:01 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b
Nov 05 11:54:01 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:01 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b" returned: 0 in 0.409s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0019e2e-995f-4fd3-b0d3-1195903c6fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aef9a9-3741-4ef2-ba0c-32740a06da29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:01 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Volume volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b (9b8c79e4-159d-497c-b6ef-4308483a5c7b): created successfully
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aef9a9-3741-4ef2-ba0c-32740a06da29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Flow 'volume_create_manager' (ff286def-d3be-430c-832d-ddb7d76d4526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-36dac532-2dc7-4cf1-8e99-240b732c378a tempest-VolumeQuotasAdminTestJSON-132422726 None] Created volume successfully.
Nov 05 11:54:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8fb00388-211c-4ab8-94e1-4f7b1f4fc471 tempest-VolumeQuotasAdminTestJSON-1262323765 None] Transfer volume completed successfully.
Nov 05 11:54:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Acquiring lock "cinder-9b8c79e4-159d-497c-b6ef-4308483a5c7b-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Lock "cinder-9b8c79e4-159d-497c-b6ef-4308483a5c7b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Acquiring lock "cinder-quobyte-9b8c79e4-159d-497c-b6ef-4308483a5c7b" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Lock "cinder-quobyte-9b8c79e4-159d-497c-b6ef-4308483a5c7b" acquired by "delete_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6542b0-ad0d-4679-ab84-e8ceb6214aa6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:54:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:05 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b
Nov 05 11:54:05 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:05 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b" returned: 0 in 0.550s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:05 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b
Nov 05 11:54:05 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:05 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9b8c79e4-159d-497c-b6ef-4308483a5c7b" returned: 0 in 0.290s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Lock "cinder-quobyte-9b8c79e4-159d-497c-b6ef-4308483a5c7b" released by "delete_volume" :: held 0.904s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Created reservations ['834241d3-1085-4f41-b444-0ae2481ebe66', 'f0886f89-7d23-4973-892a-24ec49206e3c', '819d9356-0cac-48f3-bf32-e8026aee9426', '82920f45-a8a7-47ac-8489-386ecfca82b7'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:05 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:54:05 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:06 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:06 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:54:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Deleted volume successfully.
Nov 05 11:54:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c869be1a-924e-48db-b75e-6f5e5f67954e tempest-VolumeQuotasAdminTestJSON-815071868 None] Lock "cinder-9b8c79e4-159d-497c-b6ef-4308483a5c7b-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Flow 'volume_create_manager' (de605e94-55f7-479b-a61a-d5231981b5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6a00ed-6233-4348-9873-2669fcaea471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6a00ed-6233-4348-9873-2669fcaea471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1313408060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503a91bb-dbd9-4a73-90fc-001f5ef69c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f21d18f70d9411bac61dc045745fea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:07Z,use_quota=True,user_id='c8f3bf63f8934874a4232f0d55ca21e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba87f67a-9232-474a-a541-84a1bb17eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba87f67a-9232-474a-a541-84a1bb17eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3df8691-434e-4b0a-a13f-16782da4979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3df8691-434e-4b0a-a13f-16782da4979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503a91bb-dbd9-4a73-90fc-001f5ef69c83', 'volume_name': 'volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7559ca9c-3649-4b3f-899f-41ad4efea5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7559ca9c-3649-4b3f-899f-41ad4efea5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d93e92-82e6-4354-8706-a71d5e8f239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:07 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Volume 503a91bb-dbd9-4a73-90fc-001f5ef69c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83', 'volume_size': 1}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1313408060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503a91bb-dbd9-4a73-90fc-001f5ef69c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f21d18f70d9411bac61dc045745fea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:07Z,use_quota=True,user_id='c8f3bf63f8934874a4232f0d55ca21e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Creating volume 503a91bb-dbd9-4a73-90fc-001f5ef69c83 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:54:07 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:54:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:07 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83 1073741824
Nov 05 11:54:07 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:08 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83 1073741824" returned: 0 in 0.808s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:08 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83
Nov 05 11:54:08 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:08 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83" returned: 0 in 0.409s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:54:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d93e92-82e6-4354-8706-a71d5e8f239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbaa143-e821-4557-8494-31bbb862d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:09 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Volume volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83 (503a91bb-dbd9-4a73-90fc-001f5ef69c83): created successfully
Nov 05 11:54:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbaa143-e821-4557-8494-31bbb862d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Flow 'volume_create_manager' (de605e94-55f7-479b-a61a-d5231981b5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:09 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-870aed91-70f9-48d9-afc2-d5e5e507707b tempest-TaggedAttachmentsTest-331117019 None] Created volume successfully.
Nov 05 11:54:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:54:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:13 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:54:13 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:14 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.421s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:54:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:54:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 8 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:54:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:54:19 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:19 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=27,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Flow 'volume_create_manager' (abe3ae45-02da-4f5a-a23e-d653e0b8c358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523bd12e-6459-4615-9173-9a2da8fa1e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523bd12e-6459-4615-9173-9a2da8fa1e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-471999362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdb2281-6e92-4c22-8552-8f6c0616f264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccebb4043d4648fa96e13088a1946695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:23Z,use_quota=True,user_id='cb19ae99b670416d8f3995377c651a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cc05ce-cdaa-481d-be80-160ee25f8c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cc05ce-cdaa-481d-be80-160ee25f8c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c397bbb-125d-464b-af55-f0b73e2fea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c397bbb-125d-464b-af55-f0b73e2fea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acdb2281-6e92-4c22-8552-8f6c0616f264', 'volume_name': 'volume-acdb2281-6e92-4c22-8552-8f6c0616f264', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e09f4-eda9-46fc-a5e4-a4eeb02c3745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e09f4-eda9-46fc-a5e4-a4eeb02c3745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e23581-5feb-4bd2-951c-e3b6c3993bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:23 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Volume acdb2281-6e92-4c22-8552-8f6c0616f264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acdb2281-6e92-4c22-8552-8f6c0616f264', 'volume_size': 1}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-471999362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdb2281-6e92-4c22-8552-8f6c0616f264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccebb4043d4648fa96e13088a1946695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:23Z,use_quota=True,user_id='cb19ae99b670416d8f3995377c651a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Creating volume acdb2281-6e92-4c22-8552-8f6c0616f264 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:54:23 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:54:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:23 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264 1073741824
Nov 05 11:54:23 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:24 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264 1073741824" returned: 0 in 0.924s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:24 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264
Nov 05 11:54:24 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Flow 'volume_create_manager' (fc76d833-046e-4117-9bbe-9398c0d1fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9c436d-90e3-4f87-b3cd-7daad4142b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9c436d-90e3-4f87-b3cd-7daad4142b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1232654420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1728501971d24f3d90ef81952557ecdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:25Z,use_quota=True,user_id='95cbedb2a7f649c5a19c032419d68a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baeff95f-6369-4d52-bc53-a2f23314461c),volume_type_id=baeff95f-6369-4d52-bc53-a2f23314461c)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c111b9-ad9f-484a-ad79-83e61b6fadab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c111b9-ad9f-484a-ad79-83e61b6fadab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c46493c-b37b-4d77-bdf7-10239746234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c46493c-b37b-4d77-bdf7-10239746234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5', 'volume_name': 'volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0346459-afe0-4285-8fa4-ac65053ebb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0346459-afe0-4285-8fa4-ac65053ebb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d91edc5-0573-430b-9691-8c61fddb3a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:25 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Volume ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5', 'volume_size': 1}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:25 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264" returned: 0 in 0.590s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1232654420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1728501971d24f3d90ef81952557ecdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:25Z,use_quota=True,user_id='95cbedb2a7f649c5a19c032419d68a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baeff95f-6369-4d52-bc53-a2f23314461c),volume_type_id=baeff95f-6369-4d52-bc53-a2f23314461c)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Creating volume ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:54:25 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e23581-5feb-4bd2-951c-e3b6c3993bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acdb2281-6e92-4c22-8552-8f6c0616f264', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8394b08e-d7c0-4689-a6b7-a5f4d412a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:25 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 1073741824
Nov 05 11:54:25 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:25 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Volume volume-acdb2281-6e92-4c22-8552-8f6c0616f264 (acdb2281-6e92-4c22-8552-8f6c0616f264): created successfully
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8394b08e-d7c0-4689-a6b7-a5f4d412a811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Flow 'volume_create_manager' (abe3ae45-02da-4f5a-a23e-d653e0b8c358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-01484499-0a55-410a-a970-32cce137cc8f tempest-ServerRescueNegativeTestJSON-1316653718 None] Created volume successfully.
Nov 05 11:54:25 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 1073741824" returned: 0 in 0.690s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:26 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5
Nov 05 11:54:26 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:26 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5" returned: 0 in 0.386s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d91edc5-0573-430b-9691-8c61fddb3a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6404188d-b70f-4322-8c36-6c3f15d59044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:26 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Volume volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 (ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5): created successfully
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6404188d-b70f-4322-8c36-6c3f15d59044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Flow 'volume_create_manager' (fc76d833-046e-4117-9bbe-9398c0d1fd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:26 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2d420841-f7d6-415e-b777-5a692b83cf6c tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Created volume successfully.
Nov 05 11:54:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:28 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:54:28 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:29 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.504s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:29 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:54:29 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cd993181-0735-4efa-8f93-fe84f6d6c5ca tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Retype volume completed successfully.
Nov 05 11:54:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Acquiring lock "cinder-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "cinder-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Acquiring lock "cinder-quobyte-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "cinder-quobyte-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5" acquired by "delete_volume" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:30 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de7eb00-2861-42f4-9041-f410dadea2f8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:54:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:31 devstack sudo[89420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5
Nov 05 11:54:31 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:32 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5" returned: 0 in 1.567s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:32 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5
Nov 05 11:54:32 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:33 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5" returned: 0 in 0.719s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "cinder-quobyte-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5" released by "delete_volume" :: held 2.418s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:33 devstack cinder-volume[87317]: WARNING cinder.quota [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:54:33 devstack cinder-volume[87317]: WARNING cinder.quota [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Created reservations ['a84631cf-7d42-4a2c-91f7-ab7a41d042c8', 'c2acb55a-e2bf-4629-bd55-79655340a1bb', 'bed0bd18-b75b-48bc-941e-2c2a72befa76', 'b81b4124-2a58-4054-84ac-2aaa0bc0c626'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:33 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:54:33 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:34 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.739s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:34 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:54:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Deleted volume successfully.
Nov 05 11:54:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8c18a07d-27d9-4d2f-ba1f-827ce7624b94 tempest-VolumeRetypeWithoutMigrationTest-792291015 None] Lock "cinder-ea3a80f0-f3b4-41bc-96e3-3459a5ba20b5-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:43 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=18 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:44 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=19,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=3 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:54:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Acquiring lock "cinder-acdb2281-6e92-4c22-8552-8f6c0616f264-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "cinder-acdb2281-6e92-4c22-8552-8f6c0616f264-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Acquiring lock "cinder-quobyte-acdb2281-6e92-4c22-8552-8f6c0616f264" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:54:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "cinder-quobyte-acdb2281-6e92-4c22-8552-8f6c0616f264" acquired by "delete_volume" :: waited 0.052s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:54:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4428639-aec3-45b8-960b-e9a2f8bfdf74]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:54:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:49 devstack sudo[89736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264
Nov 05 11:54:49 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:49 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264" returned: 0 in 1.078s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:50 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264
Nov 05 11:54:50 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:50 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-acdb2281-6e92-4c22-8552-8f6c0616f264" returned: 0 in 0.931s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "cinder-quobyte-acdb2281-6e92-4c22-8552-8f6c0616f264" released by "delete_volume" :: held 2.148s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:51 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Created reservations ['e79954ef-ef6a-4be8-b098-b5edfe77e2f0', 'c9cd6e72-b523-4129-ac27-34d49cbf6e85', 'b46a9c95-2189-4dc7-89d7-a8db281da80c', '20ba4f66-9729-4d9b-ba2f-f4f48bac4b0a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:54:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:51 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:54:51 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:52 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.852s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:52 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:54:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Deleted volume successfully.
Nov 05 11:54:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9089208b-ef7b-4b7b-bfe4-b57686e46cdd tempest-ServerRescueNegativeTestJSON-1316653718 None] Lock "cinder-acdb2281-6e92-4c22-8552-8f6c0616f264-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Flow 'volume_create_manager' (d67cb332-10fc-4ff5-bd3d-362779443bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e5643-0183-48fd-8e7d-30b928f8b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e5643-0183-48fd-8e7d-30b928f8b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-163643875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e910c2b7-abe9-4a36-89d2-02a686bec710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179892496dd64993bc70d7493cb34788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:58Z,use_quota=True,user_id='6ecadd24c3ec4e2085223c7f11c6a87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f840c37e-1d5d-4684-a3a0-8b6e5d1211a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f840c37e-1d5d-4684-a3a0-8b6e5d1211a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef51a3b-017b-4030-b40a-1f0c11054870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef51a3b-017b-4030-b40a-1f0c11054870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e910c2b7-abe9-4a36-89d2-02a686bec710', 'volume_name': 'volume-e910c2b7-abe9-4a36-89d2-02a686bec710', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71423f2b-9790-4a25-b451-60709647fe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71423f2b-9790-4a25-b451-60709647fe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971cf754-12a5-4293-8403-d68921f274d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Volume e910c2b7-abe9-4a36-89d2-02a686bec710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e910c2b7-abe9-4a36-89d2-02a686bec710', 'volume_size': 1}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-163643875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e910c2b7-abe9-4a36-89d2-02a686bec710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='179892496dd64993bc70d7493cb34788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:54:58Z,use_quota=True,user_id='6ecadd24c3ec4e2085223c7f11c6a87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Creating volume e910c2b7-abe9-4a36-89d2-02a686bec710 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:54:58 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:54:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:58 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710 1073741824
Nov 05 11:54:58 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:59 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710 1073741824" returned: 0 in 0.818s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:54:59 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710
Nov 05 11:54:59 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:54:59 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710" returned: 0 in 0.360s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971cf754-12a5-4293-8403-d68921f274d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e910c2b7-abe9-4a36-89d2-02a686bec710', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461e871f-f570-4797-922a-6c7e565f770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:54:59 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Volume volume-e910c2b7-abe9-4a36-89d2-02a686bec710 (e910c2b7-abe9-4a36-89d2-02a686bec710): created successfully
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461e871f-f570-4797-922a-6c7e565f770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:54:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Flow 'volume_create_manager' (d67cb332-10fc-4ff5-bd3d-362779443bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:00 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bca67bc7-6383-485f-8fb9-433b94400be7 tempest-VolumesServicesTestJSON-2107314599 None] Created volume successfully.
Nov 05 11:55:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Acquiring lock "cinder-e910c2b7-abe9-4a36-89d2-02a686bec710-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Lock "cinder-e910c2b7-abe9-4a36-89d2-02a686bec710-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Acquiring lock "cinder-quobyte-e910c2b7-abe9-4a36-89d2-02a686bec710" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Lock "cinder-quobyte-e910c2b7-abe9-4a36-89d2-02a686bec710" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:00 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25647f4-1524-4f18-bf97-edc7ad206ed5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:00 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710
Nov 05 11:55:00 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:01 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710" returned: 0 in 0.519s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:01 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710
Nov 05 11:55:01 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Flow 'volume_create_manager' (12f18e09-2f30-4275-8b1b-51549a06ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74814be-2dd4-4473-970f-668539aaf476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74814be-2dd4-4473-970f-668539aaf476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-366536925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976b8c15-e16b-4849-9a16-5826576c161f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493be688db4e4b9f885ca9dda3204c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:01Z,use_quota=True,user_id='2c82219b57dc417da20ed6854c529505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98daf41-0d24-44da-8527-d985b827b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98daf41-0d24-44da-8527-d985b827b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1da40d-9efd-402a-a4f9-aa740f55e7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1da40d-9efd-402a-a4f9-aa740f55e7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976b8c15-e16b-4849-9a16-5826576c161f', 'volume_name': 'volume-976b8c15-e16b-4849-9a16-5826576c161f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744e1db2-ed1c-4886-b1a6-075672b31151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744e1db2-ed1c-4886-b1a6-075672b31151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e0d44a-1d18-4fba-bb75-40eb8ff3dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:01 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Volume 976b8c15-e16b-4849-9a16-5826576c161f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976b8c15-e16b-4849-9a16-5826576c161f', 'volume_size': 1}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-366536925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976b8c15-e16b-4849-9a16-5826576c161f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493be688db4e4b9f885ca9dda3204c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:01Z,use_quota=True,user_id='2c82219b57dc417da20ed6854c529505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Creating volume 976b8c15-e16b-4849-9a16-5826576c161f {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:55:01 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:01 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f 1073741824
Nov 05 11:55:01 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:01 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e910c2b7-abe9-4a36-89d2-02a686bec710" returned: 0 in 0.345s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Lock "cinder-quobyte-e910c2b7-abe9-4a36-89d2-02a686bec710" released by "delete_volume" :: held 0.923s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Created reservations ['531e6ecb-5387-4b9d-8d05-e01bfe864c9c', 'a39e55ee-06d5-440e-8a2f-63726bb6f2a9', '4d000907-3013-4404-aae0-e73613d9f6e7', '7bb46e08-8b64-4c7b-be26-c9380040dd93'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:01 devstack sudo[89957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:55:01 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:02 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f 1073741824" returned: 0 in 0.698s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:02 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.466s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:02 devstack sudo[89960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f
Nov 05 11:55:02 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Deleted volume successfully.
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-207b9244-5304-4e3a-bd02-10acf87d195c tempest-VolumesServicesTestJSON-2107314599 None] Lock "cinder-e910c2b7-abe9-4a36-89d2-02a686bec710-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:02 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f" returned: 0 in 0.374s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e0d44a-1d18-4fba-bb75-40eb8ff3dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976b8c15-e16b-4849-9a16-5826576c161f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeabb296-f364-4e08-82ae-6f397041596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:02 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Volume volume-976b8c15-e16b-4849-9a16-5826576c161f (976b8c15-e16b-4849-9a16-5826576c161f): created successfully
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeabb296-f364-4e08-82ae-6f397041596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Flow 'volume_create_manager' (12f18e09-2f30-4275-8b1b-51549a06ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c6f9eb15-6ed4-4213-aeeb-8ced84ccf130 tempest-ServersNegativeTestJSON-153403868 None] Created volume successfully.
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Flow 'volume_create_manager' (3fc0af53-cb56-4ee3-96d5-761c65cb579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768696bc-ba1b-44e2-a276-02ed52ac6804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768696bc-ba1b-44e2-a276-02ed52ac6804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-939143452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8936e116-1584-49ef-92c9-baa7f3803517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493be688db4e4b9f885ca9dda3204c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:06Z,use_quota=True,user_id='2c82219b57dc417da20ed6854c529505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bcc542-160e-4b10-8092-0d46ce686db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bcc542-160e-4b10-8092-0d46ce686db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b504089-0523-4b3e-9337-45a6bd464dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b504089-0523-4b3e-9337-45a6bd464dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8936e116-1584-49ef-92c9-baa7f3803517', 'volume_name': 'volume-8936e116-1584-49ef-92c9-baa7f3803517', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129a334b-76e9-4415-b3b8-0010ae265a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129a334b-76e9-4415-b3b8-0010ae265a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e415bcf-d9fc-44a3-844c-b9ecfb6c1d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Volume 8936e116-1584-49ef-92c9-baa7f3803517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8936e116-1584-49ef-92c9-baa7f3803517', 'volume_size': 1}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-939143452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8936e116-1584-49ef-92c9-baa7f3803517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493be688db4e4b9f885ca9dda3204c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:06Z,use_quota=True,user_id='2c82219b57dc417da20ed6854c529505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Creating volume 8936e116-1584-49ef-92c9-baa7f3803517 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:55:06 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:06 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517 1073741824
Nov 05 11:55:06 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:06 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517 1073741824" returned: 0 in 0.664s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:06 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517
Nov 05 11:55:06 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:07 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517" returned: 0 in 0.375s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:55:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e415bcf-d9fc-44a3-844c-b9ecfb6c1d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8936e116-1584-49ef-92c9-baa7f3803517', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9163c1e-ce0e-480b-ae68-3d24ca0fb31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:07 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Volume volume-8936e116-1584-49ef-92c9-baa7f3803517 (8936e116-1584-49ef-92c9-baa7f3803517): created successfully
Nov 05 11:55:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9163c1e-ce0e-480b-ae68-3d24ca0fb31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Flow 'volume_create_manager' (3fc0af53-cb56-4ee3-96d5-761c65cb579f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-776c9828-49f6-41b8-98ee-41121affec74 tempest-ServersNegativeTestJSON-153403868 None] Created volume successfully.
Nov 05 11:55:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "cinder-8936e116-1584-49ef-92c9-baa7f3803517-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-8936e116-1584-49ef-92c9-baa7f3803517-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "cinder-quobyte-8936e116-1584-49ef-92c9-baa7f3803517" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-quobyte-8936e116-1584-49ef-92c9-baa7f3803517" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3d7cad-d868-4a1b-959a-adcfd1d565af]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:09 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517
Nov 05 11:55:09 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:09 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517" returned: 0 in 0.448s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:09 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517
Nov 05 11:55:09 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:09 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8936e116-1584-49ef-92c9-baa7f3803517" returned: 0 in 0.328s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-quobyte-8936e116-1584-49ef-92c9-baa7f3803517" released by "delete_volume" :: held 0.834s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Created reservations ['3ac5bcd7-e1ea-434a-a751-4524774197a3', '3f989064-3967-4bfe-ae98-3335b33bd76e', '7be8e821-0219-4869-8140-e2778e0afcb5', '31f723f5-4b17-4d4f-bdca-5689eaed300c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:10 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:55:10 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "cinder-976b8c15-e16b-4849-9a16-5826576c161f-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-976b8c15-e16b-4849-9a16-5826576c161f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "cinder-quobyte-976b8c15-e16b-4849-9a16-5826576c161f" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-quobyte-976b8c15-e16b-4849-9a16-5826576c161f" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5717e8f7-9153-4f09-9665-90cb95dc380c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:10 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.391s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:10 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Deleted volume successfully.
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c7b64442-dd08-48f5-b3d9-959d1466f12f tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-8936e116-1584-49ef-92c9-baa7f3803517-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:10 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f
Nov 05 11:55:10 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:10 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f" returned: 0 in 0.499s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:10 devstack sudo[89992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f
Nov 05 11:55:10 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:11 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-976b8c15-e16b-4849-9a16-5826576c161f" returned: 0 in 0.361s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-quobyte-976b8c15-e16b-4849-9a16-5826576c161f" released by "delete_volume" :: held 0.948s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Created reservations ['dba13bd2-3ef5-4d1d-b71e-b47f983dac42', '37fc772d-14c1-482c-a583-1f8cb6fa498c', 'c3a6a5cd-8fe3-4705-af04-7832ca1fc89a', '6710cd01-b5d0-4a2a-8935-acb308da22bf'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:11 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:55:11 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:11 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.340s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Deleted volume successfully.
Nov 05 11:55:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-93737da1-cf1b-4f23-ba6a-78c25e80c94b tempest-ServersNegativeTestJSON-153403868 None] Lock "cinder-976b8c15-e16b-4849-9a16-5826576c161f-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:55:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:13 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:55:13 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:14 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Flow 'volume_create_manager' (9bdb6e7a-c2a4-4f7f-b492-76ff67e1475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fff9da1-7831-42e1-bea3-abfda0ba8f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fff9da1-7831-42e1-bea3-abfda0ba8f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1906981424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6647502-c7ac-4f47-9f0f-f06012ff5386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e169961ef4481e98c46646dd0d5393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:19Z,use_quota=True,user_id='6d2888faf8c24598a19eb1359daca83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adcf5bd-c78c-417f-8a9b-471b2b737e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adcf5bd-c78c-417f-8a9b-471b2b737e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd037f22-29ad-46f0-82c0-535556ab8a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd037f22-29ad-46f0-82c0-535556ab8a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6647502-c7ac-4f47-9f0f-f06012ff5386', 'volume_name': 'volume-b6647502-c7ac-4f47-9f0f-f06012ff5386', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4968bde7-a126-46bc-b8bc-e7e0040d6628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4968bde7-a126-46bc-b8bc-e7e0040d6628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504f841c-2a76-4f1f-97ce-562500348010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:19 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Volume b6647502-c7ac-4f47-9f0f-f06012ff5386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6647502-c7ac-4f47-9f0f-f06012ff5386', 'volume_size': 1}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1906981424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6647502-c7ac-4f47-9f0f-f06012ff5386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e169961ef4481e98c46646dd0d5393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:19Z,use_quota=True,user_id='6d2888faf8c24598a19eb1359daca83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Creating volume b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:55:19 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:55:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:19 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 1073741824
Nov 05 11:55:19 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:20 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 1073741824" returned: 0 in 0.559s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:20 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386
Nov 05 11:55:20 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:20 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386" returned: 0 in 0.344s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504f841c-2a76-4f1f-97ce-562500348010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6647502-c7ac-4f47-9f0f-f06012ff5386', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5ade4c-0f8f-44eb-ba9e-8b2b0814ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:20 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Volume volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 (b6647502-c7ac-4f47-9f0f-f06012ff5386): created successfully
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5ade4c-0f8f-44eb-ba9e-8b2b0814ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Flow 'volume_create_manager' (9bdb6e7a-c2a4-4f7f-b492-76ff67e1475f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:20 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a345cc9c-bf66-460a-949a-2d163e846afd tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Created volume successfully.
Nov 05 11:55:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Creating offline snapshot e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 of volume b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:55:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a9fa3-8dbb-41fd-a479-f8f262439bb3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:22 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386
Nov 05 11:55:22 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:22 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386" returned: 0 in 0.556s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:22 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 1G
Nov 05 11:55:22 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:23 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 1G" returned: 0 in 0.684s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:23 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4
Nov 05 11:55:23 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:23 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" returned: 0 in 0.420s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:23 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 is being set with open permissions: ugo+rw
Nov 05 11:55:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:23 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4
Nov 05 11:55:23 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:23 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" returned: 0 in 0.347s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:24 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.info
Nov 05 11:55:24 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:24 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.info" returned: 0 in 0.361s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:24 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.info is being set with open permissions: ugo+rw
Nov 05 11:55:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:24 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.info
Nov 05 11:55:24 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:24 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.info" returned: 0 in 0.315s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-540104d1-af33-4536-abda-49bc9d135d37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Create snapshot completed successfully
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "cinder-e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "cinder-quobyte-b6647502-c7ac-4f47-9f0f-f06012ff5386" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-quobyte-b6647502-c7ac-4f47-9f0f-f06012ff5386" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "cinder-quobyte-e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-quobyte-e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Deleting offline snapshot e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 of volume b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] snapshot_file for this snap is: volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72cc0f-7346-431e-a0e0-355b01a77114]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:26 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4
Nov 05 11:55:26 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:26 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" returned: 0 in 0.515s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6647502-c7ac-4f47-9f0f-f06012ff5386(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:55:26 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b41ba-78ad-46d8-8fed-5d19c2bfba14]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:26 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386
Nov 05 11:55:26 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:27 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386" returned: 0 in 0.602s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:27 devstack sudo[90506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4
Nov 05 11:55:27 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:27 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" returned: 0 in 0.474s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:27 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4
Nov 05 11:55:27 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:28 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386.e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" returned: 0 in 0.417s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-quobyte-e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4" released by "_delete_snapshot" :: held 2.194s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-quobyte-b6647502-c7ac-4f47-9f0f-f06012ff5386" released by "delete_snapshot" :: held 2.237s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:28 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Created reservations ['065d39ae-ff77-4c8e-ab7a-a8e3a40721f1', 'f0ad9dd9-5902-41b5-b735-920b117410fa', '66c08a67-8a49-478f-b3e4-9f2a37899de4', '9442e92c-28c9-40b4-bdae-971524ddf613'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:55:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Delete snapshot completed successfully.
Nov 05 11:55:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18cc0e2e-1ec0-4006-9523-6255469f3730 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-e5613888-d5dd-4132-b7bc-9c3c7d8fc9b4-delete_snapshot" released by "delete_snapshot" :: held 2.548s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "cinder-b6647502-c7ac-4f47-9f0f-f06012ff5386-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-b6647502-c7ac-4f47-9f0f-f06012ff5386-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "cinder-quobyte-b6647502-c7ac-4f47-9f0f-f06012ff5386" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-quobyte-b6647502-c7ac-4f47-9f0f-f06012ff5386" acquired by "delete_volume" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:30 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0bc5d8-0aa9-4790-acc1-20d8a08bfdd9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:30 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386
Nov 05 11:55:30 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:30 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386" returned: 0 in 0.806s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:31 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386
Nov 05 11:55:31 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:31 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b6647502-c7ac-4f47-9f0f-f06012ff5386" returned: 0 in 0.490s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-quobyte-b6647502-c7ac-4f47-9f0f-f06012ff5386" released by "delete_volume" :: held 1.464s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Created reservations ['5b72d68d-85ae-4d4f-bbea-dd1d91232196', '44a123b9-09ef-4209-8508-ccad5e6e5b0b', '06d33c09-7ed1-4c28-88e8-598f272179b0', '56026df9-57c9-4df4-a7ad-6da3238285e3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:31 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:55:31 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:32 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.360s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:32 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Deleted volume successfully.
Nov 05 11:55:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba74c725-210e-462a-8312-7aa0db368d54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1286646327 None] Lock "cinder-b6647502-c7ac-4f47-9f0f-f06012ff5386-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-c2a207eb-58f1-489e-8a33-d46c14e12e29 req-cf81a870-1aac-42b4-8419-e02953a7ce42 tempest-TaggedAttachmentsTest-331117019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-c2a207eb-58f1-489e-8a33-d46c14e12e29 req-cf81a870-1aac-42b4-8419-e02953a7ce42 tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-c2a207eb-58f1-489e-8a33-d46c14e12e29 req-cf81a870-1aac-42b4-8419-e02953a7ce42 tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-c2a207eb-58f1-489e-8a33-d46c14e12e29 req-cf81a870-1aac-42b4-8419-e02953a7ce42 tempest-TaggedAttachmentsTest-331117019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed22330d-e6fc-44f4-be07-dddb833e53d0', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:55:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-c2a207eb-58f1-489e-8a33-d46c14e12e29 req-cf81a870-1aac-42b4-8419-e02953a7ce42 tempest-TaggedAttachmentsTest-331117019 None] attachment_update completed successfully.
Nov 05 11:55:36 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-e3cf577d-ce6f-4855-9464-adbafcde4acd req-81aa28cb-0ec4-4736-9dbb-74e3d26001a7 tempest-TaggedAttachmentsTest-331117019 None] Terminate volume connection completed successfully.
Nov 05 11:55:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-e3cf577d-ce6f-4855-9464-adbafcde4acd req-81aa28cb-0ec4-4736-9dbb-74e3d26001a7 tempest-TaggedAttachmentsTest-331117019 None] Deleting attachment ed22330d-e6fc-44f4-be07-dddb833e53d0. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:55:46 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=53,cinder:INSERT=15,cinder:UPDATE=63,cinder:DELETE=2 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:55:46 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=47,cinder:UPDATE=59,cinder:INSERT=14,cinder:DELETE=8 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:55:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Acquiring lock "cinder-503a91bb-dbd9-4a73-90fc-001f5ef69c83-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Lock "cinder-503a91bb-dbd9-4a73-90fc-001f5ef69c83-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Acquiring lock "cinder-quobyte-503a91bb-dbd9-4a73-90fc-001f5ef69c83" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:55:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Lock "cinder-quobyte-503a91bb-dbd9-4a73-90fc-001f5ef69c83" acquired by "delete_volume" :: waited 0.036s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:55:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0310a920-9514-40d5-8f06-ce47086d5436]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:55:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:53 devstack sudo[91225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83
Nov 05 11:55:53 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:54 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83" returned: 0 in 0.502s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:54 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83
Nov 05 11:55:54 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:54 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-503a91bb-dbd9-4a73-90fc-001f5ef69c83" returned: 0 in 0.296s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Lock "cinder-quobyte-503a91bb-dbd9-4a73-90fc-001f5ef69c83" released by "delete_volume" :: held 0.862s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Created reservations ['b4656091-db36-4491-b91b-7a0c5b50b922', 'f8772fc2-1b27-4a72-893b-2cd8d2117601', 'ad728e15-f354-4067-881c-e45295cb1aa5', 'e2b33cd8-4e02-4e24-bd2c-399ffd391009'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:54 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:55:54 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:54 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.331s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:55:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Deleted volume successfully.
Nov 05 11:55:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-64a07035-7a7c-4230-ac83-5506ea894a91 tempest-TaggedAttachmentsTest-331117019 None] Lock "cinder-503a91bb-dbd9-4a73-90fc-001f5ef69c83-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Flow 'volume_create_manager' (ac966663-646d-46e4-a44d-81f11bee57c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c213c1b1-4e40-41f3-82ac-b58abf9f52e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c213c1b1-4e40-41f3-82ac-b58abf9f52e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-412897047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d288f69-f503-48c9-b896-4f536abd1807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94855162d49c48eb89e7c80bcc8e9c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:57Z,use_quota=True,user_id='67d7e89fa9b042ab8efdf4d433d3acff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead33d49-abaf-436f-a103-ef97f586652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead33d49-abaf-436f-a103-ef97f586652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c1dd50-fc9e-4e29-805d-5272bf422847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c1dd50-fc9e-4e29-805d-5272bf422847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d288f69-f503-48c9-b896-4f536abd1807', 'volume_name': 'volume-4d288f69-f503-48c9-b896-4f536abd1807', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047e83f7-374a-4230-9503-3161b3bd1e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047e83f7-374a-4230-9503-3161b3bd1e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e6e776-a9f4-4772-8ff8-2ff5f818ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Volume 4d288f69-f503-48c9-b896-4f536abd1807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d288f69-f503-48c9-b896-4f536abd1807', 'volume_size': 1}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-412897047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d288f69-f503-48c9-b896-4f536abd1807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94855162d49c48eb89e7c80bcc8e9c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:55:57Z,use_quota=True,user_id='67d7e89fa9b042ab8efdf4d433d3acff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Creating volume 4d288f69-f503-48c9-b896-4f536abd1807 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:55:57 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:57 devstack sudo[91280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807 1073741824
Nov 05 11:55:57 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b8c172af-a613-4f5a-8067-d08a723923ae tempest-GroupsTest-1987614965 None] Group tempest-Group1-1386013929: creating
Nov 05 11:55:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b8c172af-a613-4f5a-8067-d08a723923ae tempest-GroupsTest-1987614965 None] Group tempest-Group1-1386013929: created successfully
Nov 05 11:55:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b8c172af-a613-4f5a-8067-d08a723923ae tempest-GroupsTest-1987614965 None] Create group completed successfully.
Nov 05 11:55:57 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807 1073741824" returned: 0 in 0.552s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:55:57 devstack sudo[91286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807
Nov 05 11:55:57 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:55:58 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root
Nov 05 11:55:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807" returned: 0 in 0.260s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:55:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:55:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:55:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e6e776-a9f4-4772-8ff8-2ff5f818ee50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d288f69-f503-48c9-b896-4f536abd1807', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fa9c09-1ca8-4d63-85d2-c4d30d8553ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:55:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Volume volume-4d288f69-f503-48c9-b896-4f536abd1807 (4d288f69-f503-48c9-b896-4f536abd1807): created successfully
Nov 05 11:55:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fa9c09-1ca8-4d63-85d2-c4d30d8553ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:55:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Flow 'volume_create_manager' (ac966663-646d-46e4-a44d-81f11bee57c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:55:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e343c357-17a3-4597-af2f-d278d2e2fac8 tempest-VolumesListAdminTestJSON-1412934311 None] Created volume successfully.
Nov 05 11:55:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-70a88f3e-8996-4614-9faa-a44dfcf7cd34 tempest-GroupsTest-1987614965 None] Group tempest-Group2-105474138: creating
Nov 05 11:55:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-70a88f3e-8996-4614-9faa-a44dfcf7cd34 tempest-GroupsTest-1987614965 None] Group tempest-Group2-105474138: created successfully
Nov 05 11:55:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-70a88f3e-8996-4614-9faa-a44dfcf7cd34 tempest-GroupsTest-1987614965 None] Create group completed successfully.
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Flow 'volume_create_manager' (120051a1-7300-455d-ae69-0ca4976d45e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9694ba33-0998-47ed-896b-613bcfa81772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9694ba33-0998-47ed-896b-613bcfa81772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-984815857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b724ce-ea44-43f2-a56d-941134313253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94855162d49c48eb89e7c80bcc8e9c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:00Z,use_quota=True,user_id='67d7e89fa9b042ab8efdf4d433d3acff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc10607-8bed-45a3-975f-ef416d3ebbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc10607-8bed-45a3-975f-ef416d3ebbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03066052-b748-4321-8138-61cab461348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03066052-b748-4321-8138-61cab461348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b724ce-ea44-43f2-a56d-941134313253', 'volume_name': 'volume-51b724ce-ea44-43f2-a56d-941134313253', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63b0596-02c4-45ef-8a16-ba98ede2540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63b0596-02c4-45ef-8a16-ba98ede2540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54689978-64e7-4eaa-a995-d803514b7c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:00 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Volume 51b724ce-ea44-43f2-a56d-941134313253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b724ce-ea44-43f2-a56d-941134313253', 'volume_size': 1}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-984815857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b724ce-ea44-43f2-a56d-941134313253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94855162d49c48eb89e7c80bcc8e9c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:00Z,use_quota=True,user_id='67d7e89fa9b042ab8efdf4d433d3acff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Creating volume 51b724ce-ea44-43f2-a56d-941134313253 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:00 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:00 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253 1073741824
Nov 05 11:56:00 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:00 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253 1073741824" returned: 0 in 0.650s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:00 devstack sudo[91297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253
Nov 05 11:56:00 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Flow 'volume_create_manager' (27da9302-50f6-48c5-adfe-9b25f9d51a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1f107d-df09-404d-9d84-9bb993a1fc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1f107d-df09-404d-9d84-9bb993a1fc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911107858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55d092ad-22c6-4565-962b-3de5ffaa5017,host='devstack@QuobyteHD#QuobyteHD',id=25a46e62-64d2-4d7b-ada3-f11804cf94c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b8661999564a09aa60fdab986227b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:01Z,use_quota=True,user_id='d047e3d2f6474300aa9b77f74dab3f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18106116-b262-417e-9a57-fdda99b99405),volume_type_id=18106116-b262-417e-9a57-fdda99b99405)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c49129c-18e4-4ee3-a0d8-35c95caa1ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c49129c-18e4-4ee3-a0d8-35c95caa1ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec39187a-53b8-4449-b3b0-84dfd62577f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec39187a-53b8-4449-b3b0-84dfd62577f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a46e62-64d2-4d7b-ada3-f11804cf94c8', 'volume_name': 'volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4e3b61-0015-4b67-8e1b-a2382a7f97a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4e3b61-0015-4b67-8e1b-a2382a7f97a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac80270d-c066-4eab-a98f-b6b5858f933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:01 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Volume 25a46e62-64d2-4d7b-ada3-f11804cf94c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8', 'volume_size': 1}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:01 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253" returned: 0 in 0.388s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.102s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=55d092ad-22c6-4565-962b-3de5ffaa5017,created_at=2026-11-05T10:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911107858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55d092ad-22c6-4565-962b-3de5ffaa5017,host='devstack@QuobyteHD#QuobyteHD',id=25a46e62-64d2-4d7b-ada3-f11804cf94c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b8661999564a09aa60fdab986227b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:01Z,use_quota=True,user_id='d047e3d2f6474300aa9b77f74dab3f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18106116-b262-417e-9a57-fdda99b99405),volume_type_id=18106116-b262-417e-9a57-fdda99b99405)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Creating volume 25a46e62-64d2-4d7b-ada3-f11804cf94c8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:01 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:01 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8 1073741824
Nov 05 11:56:01 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54689978-64e7-4eaa-a995-d803514b7c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b724ce-ea44-43f2-a56d-941134313253', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d872567-be92-45ec-b221-f27a27658bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:01 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Volume volume-51b724ce-ea44-43f2-a56d-941134313253 (51b724ce-ea44-43f2-a56d-941134313253): created successfully
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d872567-be92-45ec-b221-f27a27658bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Flow 'volume_create_manager' (120051a1-7300-455d-ae69-0ca4976d45e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e981f794-4bde-4767-aa88-744c5b201977 tempest-VolumesListAdminTestJSON-1412934311 None] Created volume successfully.
Nov 05 11:56:01 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8 1073741824" returned: 0 in 0.541s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:01 devstack sudo[91305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8
Nov 05 11:56:01 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:02 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8" returned: 0 in 0.289s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac80270d-c066-4eab-a98f-b6b5858f933b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ce2684-0ac2-474b-86e2-f643a8a544b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:02 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Volume volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8 (25a46e62-64d2-4d7b-ada3-f11804cf94c8): created successfully
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ce2684-0ac2-474b-86e2-f643a8a544b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Flow 'volume_create_manager' (27da9302-50f6-48c5-adfe-9b25f9d51a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-45e57633-aac5-4b5b-9f63-b9380860b1da tempest-GroupsTest-1987614965 None] Created volume successfully.
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Flow 'volume_create_manager' (cc009eb7-691b-44ca-94f6-a62a79b3b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae887b6-ba3e-499c-8f7a-44002126f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae887b6-ba3e-499c-8f7a-44002126f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1148494784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab71e9ad-2c6e-49a1-8f81-207a0adb404d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94855162d49c48eb89e7c80bcc8e9c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:03Z,use_quota=True,user_id='67d7e89fa9b042ab8efdf4d433d3acff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2943a8d-a918-4820-8e38-ad87f87d7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2943a8d-a918-4820-8e38-ad87f87d7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57550438-a871-4de2-aa76-1adeda09abc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57550438-a871-4de2-aa76-1adeda09abc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab71e9ad-2c6e-49a1-8f81-207a0adb404d', 'volume_name': 'volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e5b326-29f5-4b9b-8f86-824033902cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e5b326-29f5-4b9b-8f86-824033902cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed28dff-31e4-4a37-bcfa-b1c5ca12107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:02 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Volume ab71e9ad-2c6e-49a1-8f81-207a0adb404d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d', 'volume_size': 1}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1148494784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab71e9ad-2c6e-49a1-8f81-207a0adb404d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94855162d49c48eb89e7c80bcc8e9c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:03Z,use_quota=True,user_id='67d7e89fa9b042ab8efdf4d433d3acff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Creating volume ab71e9ad-2c6e-49a1-8f81-207a0adb404d {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:02 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:02 devstack sudo[91309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d 1073741824
Nov 05 11:56:02 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:03 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d 1073741824" returned: 0 in 0.455s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:03 devstack sudo[91316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d
Nov 05 11:56:03 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:03 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed28dff-31e4-4a37-bcfa-b1c5ca12107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd0f88a-043f-4be4-99bf-6d2536ebdc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Volume volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d (ab71e9ad-2c6e-49a1-8f81-207a0adb404d): created successfully
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd0f88a-043f-4be4-99bf-6d2536ebdc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Flow 'volume_create_manager' (cc009eb7-691b-44ca-94f6-a62a79b3b284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1e0d3cd1-a324-48ac-8b7b-f7285a541909 tempest-VolumesListAdminTestJSON-1412934311 None] Created volume successfully.
Nov 05 11:56:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Acquiring lock "cinder-quobyte-25a46e62-64d2-4d7b-ada3-f11804cf94c8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Lock "cinder-quobyte-25a46e62-64d2-4d7b-ada3-f11804cf94c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b8ce61-c6be-4e10-8cdb-5739e547399c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:04 devstack sudo[91319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8
Nov 05 11:56:04 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:04 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8" returned: 0 in 0.424s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:04 devstack sudo[91326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8
Nov 05 11:56:04 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:05 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-25a46e62-64d2-4d7b-ada3-f11804cf94c8" returned: 0 in 0.362s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Lock "cinder-quobyte-25a46e62-64d2-4d7b-ada3-f11804cf94c8" released by "delete_volume" :: held 0.842s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Created reservations ['bcb8808b-e147-4ffe-b47a-5c8abe7a1a84'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:05 devstack cinder-volume[87317]: WARNING cinder.quota [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-71647068 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-71647068, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:56:05 devstack cinder-volume[87317]: WARNING cinder.quota [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-71647068 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-71647068, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Created reservations ['707c7af3-1f22-4a0f-8328-52ccc204515f', '061b8787-50ba-4e3a-a2b7-4b4d28b19ebc', '7930b750-8703-4486-bfb1-d88e246db27a', 'f0c80678-3f8e-43ab-85af-1ad3badb5dc3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:05 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:05 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Created reservations ['78dbf9fd-e803-46e3-9187-31fce82868f5'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:05 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bb95cd09-7680-4d0a-acb2-ffcd82c01693 tempest-GroupsTest-1987614965 None] Delete group completed successfully.
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:05 devstack sudo[91334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:05 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:06 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4717c0b9-8d79-4d86-9503-b1754d2e6b7a tempest-GroupsTest-1987614965 None] Delete group completed successfully.
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Flow 'volume_create_manager' (1e8e0645-b2e3-4f4f-aa9a-5ab4241b39a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5929edd-822c-426a-80db-ef9bc45726d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5929edd-822c-426a-80db-ef9bc45726d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1644484396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa85f09-1142-4ab5-8e6b-602b434ce3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00a30ded9f4464ae4ffb75ce1dc8a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:06Z,use_quota=True,user_id='de35dda62df84c2fbe2112cec38b9ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93768ae8-b534-4cf7-9275-068c3833d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93768ae8-b534-4cf7-9275-068c3833d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39a7dce-69a2-48b4-9ba6-37d0a2a0f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39a7dce-69a2-48b4-9ba6-37d0a2a0f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa85f09-1142-4ab5-8e6b-602b434ce3a5', 'volume_name': 'volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c71543-621a-4dcc-9feb-dbcf50610eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c71543-621a-4dcc-9feb-dbcf50610eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e96d697-72e5-455c-8ac2-ab56095b26ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Volume 2fa85f09-1142-4ab5-8e6b-602b434ce3a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5', 'volume_size': 1}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1644484396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa85f09-1142-4ab5-8e6b-602b434ce3a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00a30ded9f4464ae4ffb75ce1dc8a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:06Z,use_quota=True,user_id='de35dda62df84c2fbe2112cec38b9ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Creating volume 2fa85f09-1142-4ab5-8e6b-602b434ce3a5 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:06 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:06 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5 1073741824
Nov 05 11:56:06 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Flow 'volume_create_manager' (a54f1ae1-9efa-4e15-ace1-4f7233b0e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8266a447-4a20-4676-802f-aa1a9c9cd79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8266a447-4a20-4676-802f-aa1a9c9cd79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beda997-8959-4b64-89ad-e4e8225727de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a34cd31384a49b2b53f9bd1ad4c606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:06Z,use_quota=True,user_id='5f3d34dc509344ba9868ec9e7f8b950e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a39596d-9326-4a99-a813-3c2b2be5475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a39596d-9326-4a99-a813-3c2b2be5475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db2767e-a0d2-407b-b2ea-5c0a74079461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db2767e-a0d2-407b-b2ea-5c0a74079461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2beda997-8959-4b64-89ad-e4e8225727de', 'volume_name': 'volume-2beda997-8959-4b64-89ad-e4e8225727de', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef12faa-2d81-49a4-9bd3-02be0ec6e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef12faa-2d81-49a4-9bd3-02be0ec6e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7def3cd-7b4b-4c1c-afd7-1c86bf0f00e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Volume 2beda997-8959-4b64-89ad-e4e8225727de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2beda997-8959-4b64-89ad-e4e8225727de', 'volume_size': 1}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:06 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5 1073741824" returned: 0 in 0.533s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:07 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5
Nov 05 11:56:07 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:07 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5" returned: 0 in 0.297s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beda997-8959-4b64-89ad-e4e8225727de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a34cd31384a49b2b53f9bd1ad4c606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:06Z,use_quota=True,user_id='5f3d34dc509344ba9868ec9e7f8b950e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Creating volume 2beda997-8959-4b64-89ad-e4e8225727de {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:07 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e96d697-72e5-455c-8ac2-ab56095b26ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b3039c-ff87-42ca-bd8d-12fc11db1768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:07 devstack sudo[91348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de 1073741824
Nov 05 11:56:07 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:07 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Volume volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5 (2fa85f09-1142-4ab5-8e6b-602b434ce3a5): created successfully
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b3039c-ff87-42ca-bd8d-12fc11db1768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Flow 'volume_create_manager' (1e8e0645-b2e3-4f4f-aa9a-5ab4241b39a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bc0e84e4-09a8-44aa-9f0b-0fe7538086e2 tempest-AttachVolumeShelveTestJSON-182697891 None] Created volume successfully.
Nov 05 11:56:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6915ab78-1eb4-47dd-9ff4-f0e2d885ba12 tempest-GroupsTest-1987614965 None] Group tempest-GroupsTest-Group-385236964: creating
Nov 05 11:56:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6915ab78-1eb4-47dd-9ff4-f0e2d885ba12 tempest-GroupsTest-1987614965 None] Group tempest-GroupsTest-Group-385236964: created successfully
Nov 05 11:56:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6915ab78-1eb4-47dd-9ff4-f0e2d885ba12 tempest-GroupsTest-1987614965 None] Create group completed successfully.
Nov 05 11:56:07 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de 1073741824" returned: 0 in 0.582s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:07 devstack sudo[91358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de
Nov 05 11:56:07 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:08 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de" returned: 0 in 0.388s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7def3cd-7b4b-4c1c-afd7-1c86bf0f00e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2beda997-8959-4b64-89ad-e4e8225727de', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71677cc7-aeb1-4622-8b6a-b960c643627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:08 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Volume volume-2beda997-8959-4b64-89ad-e4e8225727de (2beda997-8959-4b64-89ad-e4e8225727de): created successfully
Nov 05 11:56:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71677cc7-aeb1-4622-8b6a-b960c643627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Flow 'volume_create_manager' (a54f1ae1-9efa-4e15-ace1-4f7233b0e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:08 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-732410f5-f936-441a-b620-72df8b4efae6 tempest-VolumesListAdminTestJSON-1707561114 None] Created volume successfully.
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Acquiring lock "cinder-2beda997-8959-4b64-89ad-e4e8225727de-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "cinder-2beda997-8959-4b64-89ad-e4e8225727de-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Acquiring lock "cinder-quobyte-2beda997-8959-4b64-89ad-e4e8225727de" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "cinder-quobyte-2beda997-8959-4b64-89ad-e4e8225727de" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fa0201-dfd0-4540-9862-81dabced2e07]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Flow 'volume_create_manager' (63cf42f4-07cb-4db0-a3e6-fc7546c23dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:09 devstack sudo[91364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de
Nov 05 11:56:09 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f05d680-0495-4d57-8028-cee1a594c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "cinder-ab71e9ad-2c6e-49a1-8f81-207a0adb404d-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f05d680-0495-4d57-8028-cee1a594c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644914941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85224a74-6ece-4561-a951-fc0a78d94bac,host='devstack@QuobyteHD#QuobyteHD',id=59ac55ef-04fd-442b-b2cd-4d66b061aee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b8661999564a09aa60fdab986227b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:09Z,use_quota=True,user_id='d047e3d2f6474300aa9b77f74dab3f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f410a3-f2f2-4023-aa87-c1c53acdb739),volume_type_id=f2f410a3-f2f2-4023-aa87-c1c53acdb739)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d85fd5-766c-4b39-8bc6-c9288039cacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d85fd5-766c-4b39-8bc6-c9288039cacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246c502e-a77d-4414-b734-4026d371fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246c502e-a77d-4414-b734-4026d371fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ac55ef-04fd-442b-b2cd-4d66b061aee7', 'volume_name': 'volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eecd957f-bbd2-48af-8ed4-1b387a53f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eecd957f-bbd2-48af-8ed4-1b387a53f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacf4712-c5dd-4058-aa2c-2b73cdc813c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:09 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Volume 59ac55ef-04fd-442b-b2cd-4d66b061aee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7', 'volume_size': 1}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=85224a74-6ece-4561-a951-fc0a78d94bac,created_at=2026-11-05T10:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-644914941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85224a74-6ece-4561-a951-fc0a78d94bac,host='devstack@QuobyteHD#QuobyteHD',id=59ac55ef-04fd-442b-b2cd-4d66b061aee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b8661999564a09aa60fdab986227b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:09Z,use_quota=True,user_id='d047e3d2f6474300aa9b77f74dab3f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f410a3-f2f2-4023-aa87-c1c53acdb739),volume_type_id=f2f410a3-f2f2-4023-aa87-c1c53acdb739)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Creating volume 59ac55ef-04fd-442b-b2cd-4d66b061aee7 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:09 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-ab71e9ad-2c6e-49a1-8f81-207a0adb404d-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:09 devstack sudo[91370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7 1073741824
Nov 05 11:56:09 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "cinder-quobyte-ab71e9ad-2c6e-49a1-8f81-207a0adb404d" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-quobyte-ab71e9ad-2c6e-49a1-8f81-207a0adb404d" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3162c88d-30be-467a-b17e-f9612726aa17]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:10 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de" returned: 0 in 0.617s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:10 devstack sudo[91374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d
Nov 05 11:56:10 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:10 devstack sudo[91378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de
Nov 05 11:56:10 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:10 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2beda997-8959-4b64-89ad-e4e8225727de" returned: 0 in 0.403s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "cinder-quobyte-2beda997-8959-4b64-89ad-e4e8225727de" released by "delete_volume" :: held 1.154s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:10 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d" returned: 0 in 0.632s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:10 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d
Nov 05 11:56:10 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:10 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7 1073741824" returned: 0 in 0.868s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Created reservations ['6e9e9385-2e80-4445-9165-e606b686ab24', 'b3c08374-b1fc-42e3-97e2-87769c89f5dd', '9f7506e4-9aa0-4813-a156-3e548706fa3f', '079961ff-c26d-4c5d-881a-2bc6f48345f8'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:10 devstack sudo[91397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7
Nov 05 11:56:10 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:10 devstack sudo[91399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:10 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:11 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7" returned: 0 in 0.406s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:11 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacf4712-c5dd-4058-aa2c-2b73cdc813c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06579c5d-1d2a-4c03-92a6-096eb141a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab71e9ad-2c6e-49a1-8f81-207a0adb404d" returned: 0 in 0.637s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-quobyte-ab71e9ad-2c6e-49a1-8f81-207a0adb404d" released by "delete_volume" :: held 1.364s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:11 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Volume volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7 (59ac55ef-04fd-442b-b2cd-4d66b061aee7): created successfully
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06579c5d-1d2a-4c03-92a6-096eb141a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Flow 'volume_create_manager' (63cf42f4-07cb-4db0-a3e6-fc7546c23dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7b3c9292-eb7c-4ced-862e-99f7a5ad1357 tempest-GroupsTest-1987614965 None] Created volume successfully.
Nov 05 11:56:11 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.438s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Deleted volume successfully.
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Created reservations ['9d9271e5-8c4d-4254-8bf4-0829b2970d5b', '529eed0e-b3b4-4578-8038-5815c5646016', '90ac4f65-c77a-4464-b058-f954e8fdc911', 'b81234ce-1e65-4fd1-8af9-3bbcf543dd7c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e4a6f0e6-5f75-4c8c-a5ae-0ba08eea65b6 tempest-VolumesListAdminTestJSON-1707561114 None] Lock "cinder-2beda997-8959-4b64-89ad-e4e8225727de-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:11 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:11 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:11 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Deleted volume successfully.
Nov 05 11:56:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b766901-3ed8-4008-b129-aee3adbeb5ed tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-ab71e9ad-2c6e-49a1-8f81-207a0adb404d-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "cinder-51b724ce-ea44-43f2-a56d-941134313253-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-51b724ce-ea44-43f2-a56d-941134313253-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "cinder-quobyte-51b724ce-ea44-43f2-a56d-941134313253" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-quobyte-51b724ce-ea44-43f2-a56d-941134313253" acquired by "delete_volume" :: waited 0.029s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57c2c7-1aae-447e-8f92-221bae75fd01]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:12 devstack sudo[91407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253
Nov 05 11:56:12 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:13 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Flow 'volume_create_manager' (1c3763e5-264d-4fb0-9eaf-05be1f53fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd380ad-603b-47d3-8beb-a7bef6ee2b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253" returned: 0 in 0.676s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:13 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253
Nov 05 11:56:13 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd380ad-603b-47d3-8beb-a7bef6ee2b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1582086823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85224a74-6ece-4561-a951-fc0a78d94bac,host='devstack@QuobyteHD#QuobyteHD',id=ab89f736-69bd-4060-ac0d-075dcebd254e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b8661999564a09aa60fdab986227b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:13Z,use_quota=True,user_id='d047e3d2f6474300aa9b77f74dab3f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f410a3-f2f2-4023-aa87-c1c53acdb739),volume_type_id=f2f410a3-f2f2-4023-aa87-c1c53acdb739)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f66fcc-cd95-4694-a4d9-14a458e0f9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f66fcc-cd95-4694-a4d9-14a458e0f9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed67afb-5b66-4607-b021-9b7d56b04501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed67afb-5b66-4607-b021-9b7d56b04501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab89f736-69bd-4060-ac0d-075dcebd254e', 'volume_name': 'volume-ab89f736-69bd-4060-ac0d-075dcebd254e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546346c6-0041-4b75-ba52-437f11c5c285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546346c6-0041-4b75-ba52-437f11c5c285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717ff517-3b0a-42f9-a038-afa747829c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:13 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Volume ab89f736-69bd-4060-ac0d-075dcebd254e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab89f736-69bd-4060-ac0d-075dcebd254e', 'volume_size': 1}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=85224a74-6ece-4561-a951-fc0a78d94bac,created_at=2026-11-05T10:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1582086823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85224a74-6ece-4561-a951-fc0a78d94bac,host='devstack@QuobyteHD#QuobyteHD',id=ab89f736-69bd-4060-ac0d-075dcebd254e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b8661999564a09aa60fdab986227b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:13Z,use_quota=True,user_id='d047e3d2f6474300aa9b77f74dab3f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f410a3-f2f2-4023-aa87-c1c53acdb739),volume_type_id=f2f410a3-f2f2-4023-aa87-c1c53acdb739)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Creating volume ab89f736-69bd-4060-ac0d-075dcebd254e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:13 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:13 devstack sudo[91415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e 1073741824
Nov 05 11:56:13 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:13 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b724ce-ea44-43f2-a56d-941134313253" returned: 0 in 0.296s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-quobyte-51b724ce-ea44-43f2-a56d-941134313253" released by "delete_volume" :: held 1.063s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Created reservations ['6e3ca5c8-2b17-4424-b0ad-7b04a6be81a3', 'b3c1c4a2-ccd8-4c32-9416-cbb2ed423750', 'a42dacec-6611-44b4-a9bd-747b9e0ea3a0', 'a6133461-41b3-4881-afd2-d760ad7c8ed9'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:13 devstack sudo[91419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:13 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:13 devstack sudo[91423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:13 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:14 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.324s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:14 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Deleted volume successfully.
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-46bf64ef-fbbf-45d9-98f3-798575f53e69 tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-51b724ce-ea44-43f2-a56d-941134313253-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:14 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e 1073741824" returned: 0 in 0.847s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:14 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.506s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 8 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:56:14 devstack sudo[91427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e
Nov 05 11:56:14 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:14 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e" returned: 0 in 0.436s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717ff517-3b0a-42f9-a038-afa747829c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab89f736-69bd-4060-ac0d-075dcebd254e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e8c881-0b8f-4b6d-b70b-fec52cc0ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:14 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Volume volume-ab89f736-69bd-4060-ac0d-075dcebd254e (ab89f736-69bd-4060-ac0d-075dcebd254e): created successfully
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e8c881-0b8f-4b6d-b70b-fec52cc0ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Flow 'volume_create_manager' (1c3763e5-264d-4fb0-9eaf-05be1f53fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:14 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-aef3f44e-68b3-4f14-be22-57c93fca7b60 tempest-GroupsTest-1987614965 None] Created volume successfully.
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "cinder-4d288f69-f503-48c9-b896-4f536abd1807-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-4d288f69-f503-48c9-b896-4f536abd1807-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "cinder-quobyte-4d288f69-f503-48c9-b896-4f536abd1807" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-quobyte-4d288f69-f503-48c9-b896-4f536abd1807" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f7ea6-e2da-454c-9a28-208150e96336]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:15 devstack sudo[91430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807
Nov 05 11:56:15 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:15 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807" returned: 0 in 0.432s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:15 devstack sudo[91437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807
Nov 05 11:56:15 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:15 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d288f69-f503-48c9-b896-4f536abd1807" returned: 0 in 0.453s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-quobyte-4d288f69-f503-48c9-b896-4f536abd1807" released by "delete_volume" :: held 0.957s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Created reservations ['08773ffe-2dc5-4e76-948a-1416317555a5', 'b3ff0961-3eac-4307-8658-182642fb9457', 'f7bda3a1-d184-4382-81e2-b4240d97ccc1', 'dc6ec20f-d711-4eac-8487-a58b949ecd86'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:16 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-459506e8-05b0-4997-8dcd-f919e740d1b8 tempest-GroupsTest-1987614965 None] Update group completed successfully.
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:16 devstack sudo[91440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:16 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:16 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.304s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:16 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Deleted volume successfully.
Nov 05 11:56:16 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0b696bab-0359-4fd2-bcd1-ceb0f40be7ea tempest-VolumesListAdminTestJSON-1412934311 None] Lock "cinder-4d288f69-f503-48c9-b896-4f536abd1807-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2f1c83bf-8d45-47cf-ba2f-da8d77d8574d tempest-GroupsTest-1987614965 None] Update group completed successfully.
Nov 05 11:56:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Acquiring lock "cinder-quobyte-59ac55ef-04fd-442b-b2cd-4d66b061aee7" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Lock "cinder-quobyte-59ac55ef-04fd-442b-b2cd-4d66b061aee7" acquired by "delete_volume" :: waited 0.038s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:19 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[601cd8f6-8034-4ca0-ab4e-72b70793243d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:19 devstack sudo[91463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7
Nov 05 11:56:19 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:20 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7" returned: 0 in 0.676s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:20 devstack sudo[91468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7
Nov 05 11:56:20 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:20 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-59ac55ef-04fd-442b-b2cd-4d66b061aee7" returned: 0 in 0.411s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Lock "cinder-quobyte-59ac55ef-04fd-442b-b2cd-4d66b061aee7" released by "delete_volume" :: held 1.181s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Acquiring lock "cinder-quobyte-ab89f736-69bd-4060-ac0d-075dcebd254e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Lock "cinder-quobyte-ab89f736-69bd-4060-ac0d-075dcebd254e" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e313b2-d42a-43ad-90b2-dd286da15a24]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:21 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e
Nov 05 11:56:21 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-35550002-11e4-44e6-b1aa-692f0823d24b req-650f4ec9-62b8-4fb7-89e7-9ebe527df267 tempest-AttachVolumeShelveTestJSON-182697891 None] No connector for attachment 33e7ba19-21c0-4ef5-b89c-3eb406d22f7a; skipping storage backend terminate_connection call. {{(pid=87317) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}}
Nov 05 11:56:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-35550002-11e4-44e6-b1aa-692f0823d24b req-650f4ec9-62b8-4fb7-89e7-9ebe527df267 tempest-AttachVolumeShelveTestJSON-182697891 None] Deleting attachment 33e7ba19-21c0-4ef5-b89c-3eb406d22f7a. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:56:21 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e" returned: 0 in 0.702s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:21 devstack sudo[91478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e
Nov 05 11:56:21 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:22 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ab89f736-69bd-4060-ac0d-075dcebd254e" returned: 0 in 0.369s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Lock "cinder-quobyte-ab89f736-69bd-4060-ac0d-075dcebd254e" released by "delete_volume" :: held 1.171s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Created reservations ['b5a3760a-7799-4997-89a0-b045d432fd2d'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:22 devstack cinder-volume[87317]: WARNING cinder.quota [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-594605754 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-594605754, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:56:22 devstack cinder-volume[87317]: WARNING cinder.quota [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-594605754 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-594605754, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Created reservations ['aba5d510-ef3b-4d0f-b5ea-1e665785af0c', '01599e97-4f55-431f-8bf6-7757f9b1f90f', '311ac77e-24eb-4e6b-a59d-7c57bd9eee72', '7c5e27cd-5eb9-4733-aa58-602921f2f7d3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Created reservations ['d935926e-2172-4bc4-8647-2905299bfc42', '7f3f365d-4515-471b-b8a8-3b32381cffe1', 'c321d779-b2f9-4dcd-a0d3-ebe5f8ca98e9', 'c453c75f-2aef-4a75-a283-1132c40dc204'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:22 devstack sudo[91482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:22 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:23 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.297s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:23 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9ae032d0-cdf4-44db-adb3-4f734cfdb8c2 tempest-GroupsTest-1987614965 None] Delete group completed successfully.
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Flow 'volume_create_manager' (7289f712-8c5d-431d-8d66-59d466be95d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bebcdf7-6374-454e-9043-7d15f6dc6f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bebcdf7-6374-454e-9043-7d15f6dc6f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-7115930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bf5024-8606-4d58-b39d-403cb81fdfd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd7e746bd884e92b1b905fffb141a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:33Z,use_quota=True,user_id='c830ac09c25f41b091b7bb25320bf463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eeb3207-aba2-439d-9df3-2e1184a6e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eeb3207-aba2-439d-9df3-2e1184a6e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832ced33-c499-4a54-b5da-2144fb0abb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832ced33-c499-4a54-b5da-2144fb0abb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0bf5024-8606-4d58-b39d-403cb81fdfd6', 'volume_name': 'volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef12d16-f034-4973-99a4-d8b42ac4cb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef12d16-f034-4973-99a4-d8b42ac4cb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a8f061-8727-4f77-8314-5873acae031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:32 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Volume d0bf5024-8606-4d58-b39d-403cb81fdfd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6', 'volume_size': 1}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-7115930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bf5024-8606-4d58-b39d-403cb81fdfd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd7e746bd884e92b1b905fffb141a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:33Z,use_quota=True,user_id='c830ac09c25f41b091b7bb25320bf463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Creating volume d0bf5024-8606-4d58-b39d-403cb81fdfd6 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:32 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:32 devstack sudo[91521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6 1073741824
Nov 05 11:56:32 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:33 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6 1073741824" returned: 0 in 0.835s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:33 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6
Nov 05 11:56:33 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:34 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6" returned: 0 in 0.362s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a8f061-8727-4f77-8314-5873acae031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6a1f1b-98ff-4a0b-9a54-07aefc078f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Volume volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6 (d0bf5024-8606-4d58-b39d-403cb81fdfd6): created successfully
Nov 05 11:56:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6a1f1b-98ff-4a0b-9a54-07aefc078f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Flow 'volume_create_manager' (7289f712-8c5d-431d-8d66-59d466be95d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-036f7267-b1ef-4d3e-8d12-a8f7dda32021 tempest-AbsoluteLimitsTests-1108864293 None] Created volume successfully.
Nov 05 11:56:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d3e2738a-8880-4b54-9135-48dce45f4b60 tempest-GroupsV314Test-449325719 None] Group tempest-GroupsV314Test-Group-449694973: creating
Nov 05 11:56:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d3e2738a-8880-4b54-9135-48dce45f4b60 tempest-GroupsV314Test-449325719 None] Group tempest-GroupsV314Test-Group-449694973: created successfully
Nov 05 11:56:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d3e2738a-8880-4b54-9135-48dce45f4b60 tempest-GroupsV314Test-449325719 None] Create group completed successfully.
Nov 05 11:56:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Acquiring lock "cinder-d0bf5024-8606-4d58-b39d-403cb81fdfd6-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Lock "cinder-d0bf5024-8606-4d58-b39d-403cb81fdfd6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Acquiring lock "cinder-quobyte-d0bf5024-8606-4d58-b39d-403cb81fdfd6" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Lock "cinder-quobyte-d0bf5024-8606-4d58-b39d-403cb81fdfd6" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a386dc38-c6a2-47c9-b20d-e57c7be82f07]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:36 devstack sudo[91559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6
Nov 05 11:56:36 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:36 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6" returned: 0 in 0.820s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:36 devstack sudo[91570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6
Nov 05 11:56:36 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Flow 'volume_create_manager' (d08715aa-1634-443a-84ed-f851931f13d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964bb1b4-8b1a-4c4c-a5a2-b9597a451e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964bb1b4-8b1a-4c4c-a5a2-b9597a451e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353760081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ab8a4d89-df96-4bdf-a7e1-8b165775dc04,host='devstack@QuobyteHD#QuobyteHD',id=70540461-f2c7-4514-9ade-4870c431aa23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fc807915b041c2af22e7d96a962720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:37Z,use_quota=True,user_id='e4295b729df2437182ee3e20986acc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5f6c2c-5b48-41c4-9310-de6496f77dc8),volume_type_id=4b5f6c2c-5b48-41c4-9310-de6496f77dc8)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76e473a-e003-4600-88f9-2fc7f43fedd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76e473a-e003-4600-88f9-2fc7f43fedd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:37 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c659d91-1395-4194-96fb-02a738dd4ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c659d91-1395-4194-96fb-02a738dd4ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70540461-f2c7-4514-9ade-4870c431aa23', 'volume_name': 'volume-70540461-f2c7-4514-9ade-4870c431aa23', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676d8212-4cb5-45e5-819e-3fae46fcc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676d8212-4cb5-45e5-819e-3fae46fcc2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08dd544-0dab-4ac1-bc17-213a2ef052bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Volume 70540461-f2c7-4514-9ade-4870c431aa23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70540461-f2c7-4514-9ade-4870c431aa23', 'volume_size': 1}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ab8a4d89-df96-4bdf-a7e1-8b165775dc04,created_at=2026-11-05T10:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353760081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ab8a4d89-df96-4bdf-a7e1-8b165775dc04,host='devstack@QuobyteHD#QuobyteHD',id=70540461-f2c7-4514-9ade-4870c431aa23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fc807915b041c2af22e7d96a962720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:37Z,use_quota=True,user_id='e4295b729df2437182ee3e20986acc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5f6c2c-5b48-41c4-9310-de6496f77dc8),volume_type_id=4b5f6c2c-5b48-41c4-9310-de6496f77dc8)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Creating volume 70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:56:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d0bf5024-8606-4d58-b39d-403cb81fdfd6" returned: 0 in 0.707s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:37 devstack sudo[91622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 1073741824
Nov 05 11:56:37 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Lock "cinder-quobyte-d0bf5024-8606-4d58-b39d-403cb81fdfd6" released by "delete_volume" :: held 1.628s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Created reservations ['3b81f489-33e9-4bfb-b351-3a0bd01d3eca', '0adab91d-010f-455a-87b9-e20c3ecc6979', '13154e11-0d2f-4498-b3bb-23ee0269eb70', '272d99a9-4dc8-4b9c-9b59-e114e3c9d0e8'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:37 devstack sudo[91633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:56:37 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:38 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.633s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:56:38 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Deleted volume successfully.
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 1073741824" returned: 0 in 1.022s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12744729-abbf-43e0-bde3-44de6eab9ade tempest-AbsoluteLimitsTests-1108864293 None] Lock "cinder-d0bf5024-8606-4d58-b39d-403cb81fdfd6-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:38 devstack sudo[91646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23
Nov 05 11:56:38 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:38 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23" returned: 0 in 0.470s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08dd544-0dab-4ac1-bc17-213a2ef052bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70540461-f2c7-4514-9ade-4870c431aa23', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70a4f80-e1dd-499f-b4f8-8f57e5bf1122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Volume volume-70540461-f2c7-4514-9ade-4870c431aa23 (70540461-f2c7-4514-9ade-4870c431aa23): created successfully
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70a4f80-e1dd-499f-b4f8-8f57e5bf1122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Flow 'volume_create_manager' (d08715aa-1634-443a-84ed-f851931f13d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7eca8483-c689-411d-9670-94ed4d79d84b tempest-GroupsV314Test-449325719 None] Created volume successfully.
Nov 05 11:56:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:40 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Cloning volume 70540461-f2c7-4514-9ade-4870c431aa23 to volume 30ccd9c4-c470-46a9-9910-95d44cf6db16
Nov 05 11:56:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Creating offline snapshot 7596cfbb-8d17-4d42-b930-40931e36cebb of volume 70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:56:41 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3395a8-4aed-4ec9-9cb7-58a9868c47ef]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:41 devstack sudo[91667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23
Nov 05 11:56:41 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:42 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23" returned: 0 in 0.961s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:42 devstack sudo[91716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb 1G
Nov 05 11:56:42 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:43 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb 1G" returned: 0 in 1.214s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70540461-f2c7-4514-9ade-4870c431aa23 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:43 devstack sudo[91738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70540461-f2c7-4514-9ade-4870c431aa23 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb
Nov 05 11:56:43 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:44 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70540461-f2c7-4514-9ade-4870c431aa23 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb" returned: 0 in 0.908s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:44 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:56:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:44 devstack sudo[91760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb
Nov 05 11:56:44 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:45 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb" returned: 0 in 0.748s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:45 devstack sudo[91766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.info
Nov 05 11:56:45 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:45 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.info" returned: 0 in 0.590s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:45 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:56:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:45 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.info
Nov 05 11:56:45 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:46 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.info" returned: 0 in 0.656s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Acquiring lock "cinder-quobyte-30ccd9c4-c470-46a9-9910-95d44cf6db16" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-30ccd9c4-c470-46a9-9910-95d44cf6db16" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] snapshot: 7596cfbb-8d17-4d42-b930-40931e36cebb, volume: 30ccd9c4-c470-46a9-9910-95d44cf6db16,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd4de6-e74b-4592-9eec-f7674a983e23]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:46 devstack sudo[91772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb
Nov 05 11:56:46 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:47 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb" returned: 0 in 0.735s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70540461-f2c7-4514-9ade-4870c431aa23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:56:47 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[47205f2a-37ac-4f07-8aa5-cd65d3c0c20c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:56:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:47 devstack sudo[91777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23
Nov 05 11:56:47 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:48 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23" returned: 0 in 0.672s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 11:56:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 11:56:48 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 11:56:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:48 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16
Nov 05 11:56:48 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:55 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=86,cinder:INSERT=28,cinder:UPDATE=121,cinder:DELETE=9 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:56:55 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=111,cinder:SELECT=100,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Flow 'volume_create_manager' (97991722-f24b-479a-a21b-6ec4c117e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147db4bb-d69c-41bf-ba81-1919ccc8231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147db4bb-d69c-41bf-ba81-1919ccc8231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946143797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619c3235-32bf-4f4c-abcc-cc3b16a7e332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69948d5f937b405ab6ebc8ce9c3ae517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:59Z,use_quota=True,user_id='6fbbae1e385647d6bdd271a0f7b48213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057389e0-b00e-478e-863a-63ee38aff84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057389e0-b00e-478e-863a-63ee38aff84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f68c2b-a157-4ebc-acd1-f62490f814d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f68c2b-a157-4ebc-acd1-f62490f814d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619c3235-32bf-4f4c-abcc-cc3b16a7e332', 'volume_name': 'volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c54863-c5ed-4f6b-a030-2378282f3201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c54863-c5ed-4f6b-a030-2378282f3201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b1bf9d-318d-4a3a-91b4-1fc11c8c1fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:56:59 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Volume 619c3235-32bf-4f4c-abcc-cc3b16a7e332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332', 'volume_size': 1}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:56:59 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16" returned: 0 in 11.553s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23, size 1024.00 MB, duration 11.55 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:56:59 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Converted 1024.00 MB image at 88.63 MB/s
Nov 05 11:56:59 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:56:59 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16
Nov 05 11:56:59 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:56:59 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16" returned: 0 in 0.292s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-30ccd9c4-c470-46a9-9910-95d44cf6db16" released by "_copy_volume_from_snapshot" :: held 13.427s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:56:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Acquiring lock "cinder-quobyte-7596cfbb-8d17-4d42-b930-40931e36cebb" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-7596cfbb-8d17-4d42-b930-40931e36cebb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Deleting offline snapshot 7596cfbb-8d17-4d42-b930-40931e36cebb of volume 70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] snapshot_file for this snap is: volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b48b72-16f5-436a-bfa3-613c65d8ba8c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:00 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb
Nov 05 11:57:00 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:00 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb" returned: 0 in 0.459s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70540461-f2c7-4514-9ade-4870c431aa23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c029f1eb-1aaf-4811-ad75-d8ed517dbb3e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:00 devstack sudo[91864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23
Nov 05 11:57:00 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:01 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23" returned: 0 in 0.742s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:01 devstack sudo[91869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb
Nov 05 11:57:01 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:01 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb" returned: 0 in 0.447s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:01 devstack sudo[91874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb
Nov 05 11:57:01 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:02 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23.7596cfbb-8d17-4d42-b930-40931e36cebb" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-7596cfbb-8d17-4d42-b930-40931e36cebb" released by "_delete_snapshot" :: held 2.058s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.159s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.778s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946143797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619c3235-32bf-4f4c-abcc-cc3b16a7e332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69948d5f937b405ab6ebc8ce9c3ae517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:56:59Z,use_quota=True,user_id='6fbbae1e385647d6bdd271a0f7b48213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Creating volume 619c3235-32bf-4f4c-abcc-cc3b16a7e332 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:02 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:02 devstack sudo[91877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332 1073741824
Nov 05 11:57:02 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-08c33433-9544-4385-87f0-5a4c26fb2ecf tempest-GroupsV314Test-449325719 None] Create group from source-group-ab8a4d89-df96-4bdf-a7e1-8b165775dc04 completed successfully.
Nov 05 11:57:02 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332 1073741824" returned: 0 in 0.518s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:02 devstack sudo[91883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332
Nov 05 11:57:02 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:02 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Acquiring lock "cinder-quobyte-30ccd9c4-c470-46a9-9910-95d44cf6db16" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332" returned: 0 in 0.315s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b1bf9d-318d-4a3a-91b4-1fc11c8c1fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422dc47b-efce-45d8-bf7f-84d99889c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-30ccd9c4-c470-46a9-9910-95d44cf6db16" acquired by "delete_volume" :: waited 0.042s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Volume volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332 (619c3235-32bf-4f4c-abcc-cc3b16a7e332): created successfully
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422dc47b-efce-45d8-bf7f-84d99889c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Flow 'volume_create_manager' (97991722-f24b-479a-a21b-6ec4c117e488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b518635-d606-4c69-a801-a87eb6026b2d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-72be8d9a-cb34-41fe-b286-2fb1f9c77272 tempest-VolumesTransfersTest-1499640926 None] Created volume successfully.
Nov 05 11:57:03 devstack sudo[91886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16
Nov 05 11:57:03 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:03 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16" returned: 0 in 0.552s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:03 devstack sudo[91913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16
Nov 05 11:57:03 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:03 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30ccd9c4-c470-46a9-9910-95d44cf6db16" returned: 0 in 0.338s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-30ccd9c4-c470-46a9-9910-95d44cf6db16" released by "delete_volume" :: held 0.978s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-aa84b763-e12f-47b3-bd94-d8b017c2b0b7 tempest-VolumesTransfersTest-480457955 None] Transfer volume completed successfully.
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Created reservations ['58f78048-0774-45bc-a77a-8b0cbdfbef38'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:04 devstack cinder-volume[87317]: WARNING cinder.quota [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-716222608 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-716222608, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:57:04 devstack cinder-volume[87317]: WARNING cinder.quota [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-716222608 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-716222608, it is now deprecated. Please use the default quota class for default quota.
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Created reservations ['6e59a940-dc0c-4af2-ac35-65ecc0cf9195', '89bfaa0d-8892-4ba7-89b6-e759b5de5a77', 'd2ce0d09-eb41-44f6-9938-c68ec5cd9a81', '48840170-4d80-43ac-9c34-7bc081003edc'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:04 devstack sudo[91916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:04 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:04 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.271s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a4c5a96e-7cf0-4147-be2f-ebd2d306d8fc tempest-GroupsV314Test-449325719 None] Delete group completed successfully.
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Acquiring lock "cinder-619c3235-32bf-4f4c-abcc-cc3b16a7e332-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-619c3235-32bf-4f4c-abcc-cc3b16a7e332-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Acquiring lock "cinder-quobyte-619c3235-32bf-4f4c-abcc-cc3b16a7e332" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-quobyte-619c3235-32bf-4f4c-abcc-cc3b16a7e332" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc762b27-1815-4dc6-852c-9509b226b4fc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:05 devstack sudo[91919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332
Nov 05 11:57:05 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:05 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332" returned: 0 in 0.421s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:05 devstack sudo[91924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332
Nov 05 11:57:05 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:05 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-619c3235-32bf-4f4c-abcc-cc3b16a7e332" returned: 0 in 0.291s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-quobyte-619c3235-32bf-4f4c-abcc-cc3b16a7e332" released by "delete_volume" :: held 0.780s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Created reservations ['23823646-66e3-4aaf-8185-1ebcb2cb61e2', 'a17cac2f-ddd5-4336-af63-918d99cde832', '65e666db-afed-49fe-8eba-ca0d4f90e78e', '4576c330-aea7-4c4c-a8d5-25f52b872663'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Acquiring lock "cinder-quobyte-70540461-f2c7-4514-9ade-4870c431aa23" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-70540461-f2c7-4514-9ade-4870c431aa23" acquired by "delete_volume" :: waited 0.047s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:05 devstack sudo[91927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:05 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[099618d1-5b6d-47ed-8e80-64fdce827c83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:06 devstack sudo[91929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23
Nov 05 11:57:06 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:06 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.321s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Deleted volume successfully.
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4631d820-0bc2-4b64-a1c6-6bfa579d86ec tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-619c3235-32bf-4f4c-abcc-cc3b16a7e332-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:06 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23" returned: 0 in 0.485s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:06 devstack sudo[91935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23
Nov 05 11:57:06 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Flow 'volume_create_manager' (abeb9684-2f78-409e-b06f-87e6e1d8738c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0e8b49-be7d-4d0a-b39d-3c648735eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0e8b49-be7d-4d0a-b39d-3c648735eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-237677914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d13255-0984-434d-8698-f5e03351595f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69948d5f937b405ab6ebc8ce9c3ae517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:06Z,use_quota=True,user_id='6fbbae1e385647d6bdd271a0f7b48213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda8e5b7-04b4-4800-9dbe-c793b545f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda8e5b7-04b4-4800-9dbe-c793b545f846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a4de30-de4a-47eb-ad53-7a0e84f4209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a4de30-de4a-47eb-ad53-7a0e84f4209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d13255-0984-434d-8698-f5e03351595f', 'volume_name': 'volume-b7d13255-0984-434d-8698-f5e03351595f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a6335c-57a1-4d89-bfe1-6755d90f421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a6335c-57a1-4d89-bfe1-6755d90f421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad0b08d-0c3b-49d8-ae37-f1ed3563b20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Volume b7d13255-0984-434d-8698-f5e03351595f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d13255-0984-434d-8698-f5e03351595f', 'volume_size': 1}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-237677914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d13255-0984-434d-8698-f5e03351595f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69948d5f937b405ab6ebc8ce9c3ae517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:06Z,use_quota=True,user_id='6fbbae1e385647d6bdd271a0f7b48213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Creating volume b7d13255-0984-434d-8698-f5e03351595f {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:06 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:06 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:06 devstack sudo[91938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f 1073741824
Nov 05 11:57:06 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-70540461-f2c7-4514-9ade-4870c431aa23" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Lock "cinder-quobyte-70540461-f2c7-4514-9ade-4870c431aa23" released by "delete_volume" :: held 0.854s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Created reservations ['7a8add3b-21dd-4b2b-b3d7-7822e03d9217'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Created reservations ['2ef4510e-2e50-441d-ba81-00f7f9e834a4', 'aaf4e50c-7802-44ad-be3b-0b53bcb5aa76', '57c89e96-ee78-4293-bafe-abb10734e480', 'b7bd591c-9029-4af4-8d95-d1ffbb1a378f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:06 devstack sudo[91943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:06 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:07 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f 1073741824" returned: 0 in 0.498s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:07 devstack sudo[91945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f
Nov 05 11:57:07 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:07 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.333s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b4f34312-a35b-494a-a9f9-f053196288c9 tempest-GroupsV314Test-449325719 None] Delete group completed successfully.
Nov 05 11:57:07 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad0b08d-0c3b-49d8-ae37-f1ed3563b20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d13255-0984-434d-8698-f5e03351595f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f6aad7-f2c0-4e87-9fdb-146ffb016a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:07 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Volume volume-b7d13255-0984-434d-8698-f5e03351595f (b7d13255-0984-434d-8698-f5e03351595f): created successfully
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f6aad7-f2c0-4e87-9fdb-146ffb016a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Flow 'volume_create_manager' (abeb9684-2f78-409e-b06f-87e6e1d8738c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7c5ef9e7-ebfe-4c96-b557-9b761241f93d tempest-VolumesTransfersTest-1499640926 None] Created volume successfully.
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Acquiring lock "cinder-b7d13255-0984-434d-8698-f5e03351595f-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-b7d13255-0984-434d-8698-f5e03351595f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Acquiring lock "cinder-quobyte-b7d13255-0984-434d-8698-f5e03351595f" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-quobyte-b7d13255-0984-434d-8698-f5e03351595f" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc16d7-c53d-4cdd-aca9-ee6276d6372b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:09 devstack sudo[91951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f
Nov 05 11:57:09 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:09 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f" returned: 0 in 0.446s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:09 devstack sudo[91956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f
Nov 05 11:57:09 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:09 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b7d13255-0984-434d-8698-f5e03351595f" returned: 0 in 0.348s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-quobyte-b7d13255-0984-434d-8698-f5e03351595f" released by "delete_volume" :: held 0.850s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Created reservations ['32b77947-65be-4b1e-810e-f839b9301ea8', 'e5a4fdf7-5323-4bdc-97ed-c1947d5c59e6', '5ef6d8f9-93a2-4b95-a1f2-87b2e8ea19fb', '5f168bcc-f8ce-4533-b000-ad654d804100'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:10 devstack sudo[91959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:10 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:10 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.328s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:10 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Deleted volume successfully.
Nov 05 11:57:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3b66d1f3-3a94-4566-9218-ac8e960c19eb tempest-VolumesTransfersTest-1714348828 None] Lock "cinder-b7d13255-0984-434d-8698-f5e03351595f-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:13 devstack sudo[91963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:13 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:13 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.307s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 8 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:57:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Flow 'volume_create_manager' (28a03596-f27d-4e22-a302-5a4ef0889af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42879c9-24d7-4671-bc45-102489298797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42879c9-24d7-4671-bc45-102489298797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1904270415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb83b78-9bc5-4215-a235-7bc5599c5e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d641b0b2024dbeb988a612121453d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:15Z,use_quota=True,user_id='16cc9c62937b439b8202c5dc5a0b8ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cb2a0d-081f-43d0-b2fb-ba43e5c29b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cb2a0d-081f-43d0-b2fb-ba43e5c29b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008db227-d6a9-44ec-a798-1218a33edc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008db227-d6a9-44ec-a798-1218a33edc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb83b78-9bc5-4215-a235-7bc5599c5e3b', 'volume_name': 'volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a31ff2c-3b65-4866-8866-e51c3da92cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a31ff2c-3b65-4866-8866-e51c3da92cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c74af8-9a77-47f3-9dbe-a34340ab8755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:15 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Volume adb83b78-9bc5-4215-a235-7bc5599c5e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b', 'volume_size': 1}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1904270415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb83b78-9bc5-4215-a235-7bc5599c5e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d641b0b2024dbeb988a612121453d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:15Z,use_quota=True,user_id='16cc9c62937b439b8202c5dc5a0b8ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Creating volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:15 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:15 devstack sudo[91968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b 1073741824
Nov 05 11:57:15 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:15 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b 1073741824" returned: 0 in 0.660s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:15 devstack sudo[91974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b
Nov 05 11:57:15 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:16 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b" returned: 0 in 0.518s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c74af8-9a77-47f3-9dbe-a34340ab8755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacf6455-1cc7-444d-825d-1c1b64d38668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:16 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Volume volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b (adb83b78-9bc5-4215-a235-7bc5599c5e3b): created successfully
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacf6455-1cc7-444d-825d-1c1b64d38668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Flow 'volume_create_manager' (28a03596-f27d-4e22-a302-5a4ef0889af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Flow 'volume_create_manager' (02d756ea-f56b-47ee-9d03-cddb177c8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e4db34-c54b-478d-ae06-2e6ed604d3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:16 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d612be75-ed5a-4a59-8388-055bb86db6e7 tempest-SnapshotsActionsTest-1605373956 None] Created volume successfully.
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e4db34-c54b-478d-ae06-2e6ed604d3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2084859393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7e0517-b5d8-422d-9360-44205ec38a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539e6144c4a0434aba55148e74c1977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:16Z,use_quota=True,user_id='d02532ab6c3b48e4bec780016065756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877b9ef7-b41e-49fb-98af-b7842e4fc7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877b9ef7-b41e-49fb-98af-b7842e4fc7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690bd024-ad0e-4c85-8f72-a1179e8ad86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690bd024-ad0e-4c85-8f72-a1179e8ad86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7e0517-b5d8-422d-9360-44205ec38a36', 'volume_name': 'volume-6d7e0517-b5d8-422d-9360-44205ec38a36', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248e531f-28e5-446b-8e58-ed813118c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248e531f-28e5-446b-8e58-ed813118c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc991466-b1f0-4ad9-b1a5-fea55fd2f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:16 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Volume 6d7e0517-b5d8-422d-9360-44205ec38a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7e0517-b5d8-422d-9360-44205ec38a36', 'volume_size': 1}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2084859393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7e0517-b5d8-422d-9360-44205ec38a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539e6144c4a0434aba55148e74c1977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:16Z,use_quota=True,user_id='d02532ab6c3b48e4bec780016065756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Creating volume 6d7e0517-b5d8-422d-9360-44205ec38a36 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:16 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:57:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:16 devstack sudo[91979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36 1073741824
Nov 05 11:57:16 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:17 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36 1073741824" returned: 0 in 1.151s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:17 devstack sudo[92005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36
Nov 05 11:57:17 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:18 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36" returned: 0 in 0.464s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.324s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc991466-b1f0-4ad9-b1a5-fea55fd2f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7e0517-b5d8-422d-9360-44205ec38a36', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10814da3-8de1-40e8-9004-ae4807ff1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Creating offline snapshot dc8da3c2-6fa7-491a-b69b-0818cb66232e of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:57:18 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Volume volume-6d7e0517-b5d8-422d-9360-44205ec38a36 (6d7e0517-b5d8-422d-9360-44205ec38a36): created successfully
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10814da3-8de1-40e8-9004-ae4807ff1efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Flow 'volume_create_manager' (02d756ea-f56b-47ee-9d03-cddb177c8b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4bd13d-2b7c-4ecf-a9be-0f03aae5f418]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d37637b3-634f-461b-be6a-f2908b08130c tempest-ServerActionsTestOtherA-1509821086 None] Created volume successfully.
Nov 05 11:57:18 devstack sudo[92010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b
Nov 05 11:57:18 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:19 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b" returned: 0 in 0.654s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:19 devstack sudo[92016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e 1G
Nov 05 11:57:19 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:19 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e 1G" returned: 0 in 0.763s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:19 devstack sudo[92025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:19 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:20 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.527s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:20 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e is being set with open permissions: ugo+rw
Nov 05 11:57:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:20 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:20 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:20 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.451s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:20 devstack sudo[92036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.info
Nov 05 11:57:20 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Flow 'volume_create_manager' (cc4146a7-6518-4b5a-b83f-b26be2f2ea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da5bfac-b8d1-4e33-9240-a8927b51e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da5bfac-b8d1-4e33-9240-a8927b51e01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-214664423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57246c5c-e6e9-48be-b5d0-a71866f80730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8c52ee7e2d4fbea6f6e31c06d2bbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:21Z,use_quota=True,user_id='fb6b2e3b146a4761ba2b47eec07cd102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2d83f8-7953-40a4-a092-3a6247cac0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2d83f8-7953-40a4-a092-3a6247cac0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b631d1-b698-43f7-ab1d-c28a2637b560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b631d1-b698-43f7-ab1d-c28a2637b560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57246c5c-e6e9-48be-b5d0-a71866f80730', 'volume_name': 'volume-57246c5c-e6e9-48be-b5d0-a71866f80730', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b7b69b-58f2-4af0-8bb3-bbd8cd19543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b7b69b-58f2-4af0-8bb3-bbd8cd19543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24a94b7-24ae-4b60-a256-cf4fe3ed745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:21 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Volume 57246c5c-e6e9-48be-b5d0-a71866f80730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57246c5c-e6e9-48be-b5d0-a71866f80730', 'volume_size': 1}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:21 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.info" returned: 0 in 0.312s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:21 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.info is being set with open permissions: ugo+rw
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:21 devstack sudo[92039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.info
Nov 05 11:57:21 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:21 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.info" returned: 0 in 0.355s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-214664423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57246c5c-e6e9-48be-b5d0-a71866f80730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8c52ee7e2d4fbea6f6e31c06d2bbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:21Z,use_quota=True,user_id='fb6b2e3b146a4761ba2b47eec07cd102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Creating volume 57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:21 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:57:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:21 devstack sudo[92042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 1073741824
Nov 05 11:57:21 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8815e5f6-c114-4a5e-94a4-0d93f0a7e91a tempest-SnapshotsActionsTest-1605373956 None] Create snapshot completed successfully
Nov 05 11:57:22 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 1073741824" returned: 0 in 0.627s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:22 devstack sudo[92048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730
Nov 05 11:57:22 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Acquiring lock "cinder-2fa85f09-1142-4ab5-8e6b-602b434ce3a5-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "cinder-2fa85f09-1142-4ab5-8e6b-602b434ce3a5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Acquiring lock "cinder-quobyte-2fa85f09-1142-4ab5-8e6b-602b434ce3a5" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "cinder-quobyte-2fa85f09-1142-4ab5-8e6b-602b434ce3a5" acquired by "delete_volume" :: waited 0.044s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[549b3364-42c3-4d5d-94b1-2f85a1580cb0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:22 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730" returned: 0 in 0.540s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24a94b7-24ae-4b60-a256-cf4fe3ed745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57246c5c-e6e9-48be-b5d0-a71866f80730', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a90752-e666-4b37-8d79-a561fa88615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:23 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Volume volume-57246c5c-e6e9-48be-b5d0-a71866f80730 (57246c5c-e6e9-48be-b5d0-a71866f80730): created successfully
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a90752-e666-4b37-8d79-a561fa88615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:23 devstack sudo[92054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5
Nov 05 11:57:23 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Flow 'volume_create_manager' (cc4146a7-6518-4b5a-b83f-b26be2f2ea31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2ec28679-4fe4-431b-8f3e-05944937a307 tempest-VolumesCloneTest-1593078306 None] Created volume successfully.
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Creating offline snapshot 30e2c160-092a-4d09-aa3f-169adc3f7715 of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce2fff-402c-43ec-a13a-f4160d95f7f7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:23 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5" returned: 0 in 0.550s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:23 devstack sudo[92057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:23 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:23 devstack sudo[92064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5
Nov 05 11:57:23 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:23 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2fa85f09-1142-4ab5-8e6b-602b434ce3a5" returned: 0 in 0.383s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "cinder-quobyte-2fa85f09-1142-4ab5-8e6b-602b434ce3a5" released by "delete_volume" :: held 1.025s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:23 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.665s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:23 devstack sudo[92078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 1G
Nov 05 11:57:23 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Created reservations ['b9b1b2d8-1656-4b98-a0e5-963489bfc0a3', '41d32de8-f858-45c2-b9bb-f33569abe7d6', '3ff6e270-a9b0-4a6e-9fc5-b12a660d2dcd', '6b4054e2-5322-4f87-a775-a47b14342d2b'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Flow 'volume_create_manager' (75720f4f-3900-48bb-8624-ee7683ba721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece1ef4a-8c33-45fa-a6a7-d179e5509b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece1ef4a-8c33-45fa-a6a7-d179e5509b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1468964295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8c52ee7e2d4fbea6f6e31c06d2bbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=57246c5c-e6e9-48be-b5d0-a71866f80730,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:24Z,use_quota=True,user_id='fb6b2e3b146a4761ba2b47eec07cd102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6d734a-b1e1-4f25-a48f-0e93fee15f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6d734a-b1e1-4f25-a48f-0e93fee15f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ca1b9-e2ae-471e-b4c1-261475bbb7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ca1b9-e2ae-471e-b4c1-261475bbb7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b', 'volume_name': 'volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b', 'volume_size': 2, 'source_volid': '57246c5c-e6e9-48be-b5d0-a71866f80730', 'source_volstatus': 'available'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd71a66-7dfb-447c-bddf-7bee0ad4e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd71a66-7dfb-447c-bddf-7bee0ad4e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b8a93a-05ed-4fbc-bf4e-0e5a5aaea1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:24 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Volume 1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b', 'volume_size': 2, 'source_volid': '57246c5c-e6e9-48be-b5d0-a71866f80730', 'source_volstatus': 'available'}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:24 devstack sudo[92082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:24 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:24 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.349s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Deleted volume successfully.
Nov 05 11:57:24 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 1G" returned: 0 in 0.712s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7c6b2b20-6d3c-4213-bfde-de5d13c231a6 tempest-AttachVolumeShelveTestJSON-182697891 None] Lock "cinder-2fa85f09-1142-4ab5-8e6b-602b434ce3a5-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:24 devstack sudo[92087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715
Nov 05 11:57:24 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:25 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715" returned: 0 in 0.464s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:25 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 is being set with open permissions: ugo+rw
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:25 devstack sudo[92092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715
Nov 05 11:57:25 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:25 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715" returned: 0 in 0.386s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.342s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:25 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Cloning volume 57246c5c-e6e9-48be-b5d0-a71866f80730 to volume 1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b
Nov 05 11:57:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c3747a81-0142-43ee-a8c9-b058419901a8 tempest-SnapshotsActionsTest-1605373956 None] Create snapshot completed successfully
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Creating offline snapshot f677e0b4-d619-427c-b353-e0a1604b3ebc of volume 57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0eeb7d-9627-4050-be56-dd8c06a3a5f6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:25 devstack sudo[92099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730
Nov 05 11:57:25 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:26 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730" returned: 0 in 0.604s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:26 devstack sudo[92114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc 1G
Nov 05 11:57:26 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-30e2c160-092a-4d09-aa3f-169adc3f7715-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-30e2c160-092a-4d09-aa3f-169adc3f7715-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-30e2c160-092a-4d09-aa3f-169adc3f7715" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-30e2c160-092a-4d09-aa3f-169adc3f7715" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Deleting offline snapshot 30e2c160-092a-4d09-aa3f-169adc3f7715 of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] snapshot_file for this snap is: volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0a34e1-b6c2-400d-84e8-863fe2052ebf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:27 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc 1G" returned: 0 in 0.894s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57246c5c-e6e9-48be-b5d0-a71866f80730 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:27 devstack sudo[92123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57246c5c-e6e9-48be-b5d0-a71866f80730 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc
Nov 05 11:57:27 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:27 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715
Nov 05 11:57:27 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:27 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57246c5c-e6e9-48be-b5d0-a71866f80730 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc" returned: 0 in 0.437s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:27 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc is being set with open permissions: ugo+rw
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:27 devstack sudo[92131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc
Nov 05 11:57:27 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:27 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715" returned: 0 in 0.671s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b2564-3e51-4662-ba6e-91e38f081650]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:28 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc" returned: 0 in 0.410s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:28 devstack sudo[92135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:28 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:28 devstack sudo[92139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.info
Nov 05 11:57:28 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:28 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.584s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:28 devstack sudo[92145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715
Nov 05 11:57:28 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:28 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.info" returned: 0 in 0.504s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:28 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.info is being set with open permissions: ugo+rw
Nov 05 11:57:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:28 devstack sudo[92149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.info
Nov 05 11:57:28 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:28 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.info" returned: 0 in 0.391s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Acquiring lock "cinder-quobyte-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] snapshot: f677e0b4-d619-427c-b353-e0a1604b3ebc, volume: 1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 11:57:29 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715" returned: 0 in 0.647s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff300a-af9a-4571-8be9-f8468dd33ad7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:29 devstack sudo[92157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715
Nov 05 11:57:29 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:29 devstack sudo[92158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc
Nov 05 11:57:29 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:29 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.30e2c160-092a-4d09-aa3f-169adc3f7715" returned: 0 in 0.433s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-30e2c160-092a-4d09-aa3f-169adc3f7715" released by "_delete_snapshot" :: held 2.632s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" released by "delete_snapshot" :: held 2.674s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Created reservations ['2d21a081-b5c6-4232-984d-2969170ddd4f', '1f2017af-cd93-41ad-82da-2e0aa2b52d49', 'c663b9bd-c3ba-4e60-bd00-05c5f41f6c04', '0a0a25a3-92fa-41dd-8d7c-dec0d8fbad36'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:29 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc" returned: 0 in 0.839s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57246c5c-e6e9-48be-b5d0-a71866f80730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2390bee5-3e58-4d1b-8608-2db23c11f2b7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Delete snapshot completed successfully.
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fbb22e75-3559-4031-a7db-65011d948e96 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-30e2c160-092a-4d09-aa3f-169adc3f7715-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:30 devstack sudo[92192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730
Nov 05 11:57:30 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:30 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730" returned: 0 in 0.772s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 11:57:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:30 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b
Nov 05 11:57:30 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:41 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=58,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:57:41 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=81,cinder:SELECT=59,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:57:42 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" returned: 0 in 11.856s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:42 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730, size 1024.00 MB, duration 11.86 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:57:42 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Converted 1024.00 MB image at 86.36 MB/s
Nov 05 11:57:42 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b is being set with open permissions: ugo+rw
Nov 05 11:57:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:42 devstack sudo[92232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b
Nov 05 11:57:42 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:42 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" returned: 0 in 0.288s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" released by "_copy_volume_from_snapshot" :: held 13.907s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Acquiring lock "cinder-quobyte-f677e0b4-d619-427c-b353-e0a1604b3ebc" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-f677e0b4-d619-427c-b353-e0a1604b3ebc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Deleting offline snapshot f677e0b4-d619-427c-b353-e0a1604b3ebc of volume 57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] snapshot_file for this snap is: volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3c23b-8708-4fe1-97ea-cee015e6766e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:43 devstack sudo[92235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc
Nov 05 11:57:43 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:43 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc" returned: 0 in 0.430s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57246c5c-e6e9-48be-b5d0-a71866f80730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5cd98-29d9-43ed-8cae-dd9179c049ea]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:43 devstack sudo[92241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730
Nov 05 11:57:43 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:44 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730" returned: 0 in 0.626s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:44 devstack sudo[92246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc
Nov 05 11:57:44 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:44 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc" returned: 0 in 0.476s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:44 devstack sudo[92274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc
Nov 05 11:57:44 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:45 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730.f677e0b4-d619-427c-b353-e0a1604b3ebc" returned: 0 in 0.356s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-f677e0b4-d619-427c-b353-e0a1604b3ebc" released by "_delete_snapshot" :: held 2.041s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.549s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.964s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Creating offline snapshot 21bf980f-34fa-4cf6-a72d-b5af8202d2da of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b8a93a-05ed-4fbc-bf4e-0e5a5aaea1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b', 'volume_size': 2, 'source_volid': '57246c5c-e6e9-48be-b5d0-a71866f80730', 'source_volstatus': 'available'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a163bbe3-774e-428d-a6f3-ca91f700b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2fc009-1003-40e4-8526-f0d623836ea6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:45 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Volume volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b (1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b): created successfully
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a163bbe3-774e-428d-a6f3-ca91f700b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Flow 'volume_create_manager' (75720f4f-3900-48bb-8624-ee7683ba721e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-45341592-53aa-42b7-872d-1dcb205143c2 tempest-VolumesCloneTest-1593078306 None] Created volume successfully.
Nov 05 11:57:45 devstack sudo[92293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:45 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:45 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.461s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:45 devstack sudo[92305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da 1G
Nov 05 11:57:45 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:46 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da 1G" returned: 0 in 0.600s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:46 devstack sudo[92310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da
Nov 05 11:57:46 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:46 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Acquiring lock "cinder-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da" returned: 0 in 0.395s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:46 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da is being set with open permissions: ugo+rw
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Lock "cinder-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:46 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da
Nov 05 11:57:46 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Acquiring lock "cinder-quobyte-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c882d-b7d2-42ce-a9ae-6593d22ddfb1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:46 devstack sudo[92317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b
Nov 05 11:57:46 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:46 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da" returned: 0 in 0.300s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b2aeaae0-a90a-4e4a-9a7f-403d28deb259 tempest-SnapshotsActionsTest-1605373956 None] Create snapshot completed successfully
Nov 05 11:57:47 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" returned: 0 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:47 devstack sudo[92323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b
Nov 05 11:57:47 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-21bf980f-34fa-4cf6-a72d-b5af8202d2da-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-21bf980f-34fa-4cf6-a72d-b5af8202d2da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-21bf980f-34fa-4cf6-a72d-b5af8202d2da" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-21bf980f-34fa-4cf6-a72d-b5af8202d2da" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Deleting offline snapshot 21bf980f-34fa-4cf6-a72d-b5af8202d2da of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:57:47 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] snapshot_file for this snap is: volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" returned: 0 in 0.347s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa227dc8-5b3c-4f17-a165-b427f75fc425]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b" released by "delete_volume" :: held 0.809s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Created reservations ['04aa86ca-043e-4b33-8812-22d1a21c6538', '2dc56068-4c97-4a97-8e4d-d0d271055c19', '3d7abcc4-d673-42d9-b1c0-bb81a07faba5', '79b5202f-f750-4b89-a50b-931c2f0fa630'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:47 devstack sudo[92326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da
Nov 05 11:57:47 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:47 devstack sudo[92328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:47 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Acquiring lock "cinder-57246c5c-e6e9-48be-b5d0-a71866f80730-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Lock "cinder-57246c5c-e6e9-48be-b5d0-a71866f80730-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Acquiring lock "cinder-quobyte-57246c5c-e6e9-48be-b5d0-a71866f80730" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-57246c5c-e6e9-48be-b5d0-a71866f80730" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:48 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da" returned: 0 in 0.552s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:48 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[26701408-895e-45e6-b4d2-bd8b390ea8cf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[333886af-18d1-46f0-8138-3d1e70287116]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:48 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Deleted volume successfully.
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-14066b6c-84a8-40f0-9cf7-a7c5c46fc17d tempest-VolumesCloneTest-1593078306 None] Lock "cinder-1f983a62-ad2e-4bfd-9fd7-4cb9c13ad60b-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:48 devstack sudo[92334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730
Nov 05 11:57:48 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:48 devstack sudo[92335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:48 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:48 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730" returned: 0 in 0.458s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:48 devstack sudo[92344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730
Nov 05 11:57:48 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:48 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.472s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:48 devstack sudo[92346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da
Nov 05 11:57:48 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:48 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57246c5c-e6e9-48be-b5d0-a71866f80730" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Lock "cinder-quobyte-57246c5c-e6e9-48be-b5d0-a71866f80730" released by "delete_volume" :: held 0.808s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:48 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Created reservations ['13684098-08a2-42ba-931e-1fa7d6cbddc8', 'cd3054c5-0835-40bb-8d50-70c938893890', '758caf18-9f78-4275-8c3a-041266ee077c', 'c6f97e20-18ba-459a-a3a6-9cda0755c795'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:49 devstack sudo[92353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:49 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:49 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da" returned: 0 in 0.588s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:49 devstack sudo[92355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da
Nov 05 11:57:49 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:49 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.354s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Deleted volume successfully.
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-312d1cb5-7d67-4e90-80bd-4612fd4dddcb tempest-VolumesCloneTest-1593078306 None] Lock "cinder-57246c5c-e6e9-48be-b5d0-a71866f80730-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:49 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.21bf980f-34fa-4cf6-a72d-b5af8202d2da" returned: 0 in 0.334s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-21bf980f-34fa-4cf6-a72d-b5af8202d2da" released by "_delete_snapshot" :: held 2.091s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" released by "delete_snapshot" :: held 2.119s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Created reservations ['9183ec45-dbf2-430d-bd2c-bdc3cb98a6c0', 'ea5cb7a9-58b1-4ee6-8308-8b5080cecc7c', '8702e6d6-479d-4ffd-99aa-c7eb09986a05', '923eb1a3-1504-4de5-8811-a7fe5904aa08'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Delete snapshot completed successfully.
Nov 05 11:57:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-27853740-867e-49c8-aac3-5b8bd5b1c6b4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-21bf980f-34fa-4cf6-a72d-b5af8202d2da-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Creating offline snapshot 3bf509a5-8a32-4374-aa1f-e4043c75a706 of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d113399-c976-4eb7-bec3-4b8d769ea64e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:51 devstack sudo[92359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:51 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:51 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.584s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:51 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 1G
Nov 05 11:57:51 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:52 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 1G" returned: 0 in 0.768s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:52 devstack sudo[92370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706
Nov 05 11:57:52 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:53 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706" returned: 0 in 0.488s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:53 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 is being set with open permissions: ugo+rw
Nov 05 11:57:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:53 devstack sudo[92376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706
Nov 05 11:57:53 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:53 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706" returned: 0 in 0.418s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7bfbf4fd-a96c-4270-8c93-5e882b00bf91 tempest-SnapshotsActionsTest-1605373956 None] Create snapshot completed successfully
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-3bf509a5-8a32-4374-aa1f-e4043c75a706-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-3bf509a5-8a32-4374-aa1f-e4043c75a706-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-3bf509a5-8a32-4374-aa1f-e4043c75a706" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-3bf509a5-8a32-4374-aa1f-e4043c75a706" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Deleting offline snapshot 3bf509a5-8a32-4374-aa1f-e4043c75a706 of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] snapshot_file for this snap is: volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af7f5a-4591-4d70-898c-f5b585440ef9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:57:54 devstack sudo[92380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706
Nov 05 11:57:54 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Flow 'volume_create_manager' (5feedb97-7ec0-4f7a-ac60-681899b7a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d00f7d4-5019-412e-8426-4cc1f7b3d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d00f7d4-5019-412e-8426-4cc1f7b3d224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1152511080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cc4721-1cac-4083-85f4-fb82feed8104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c27c466ae5f45d0b520241220f602ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:55Z,use_quota=True,user_id='0f8f9aa269e044e7ba0fc37c0501a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b11b4a2-db09-44de-9ed4-5e1cd75c3113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b11b4a2-db09-44de-9ed4-5e1cd75c3113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7078bec7-7ba3-46cf-a1e3-2a991a8b1bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7078bec7-7ba3-46cf-a1e3-2a991a8b1bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7cc4721-1cac-4083-85f4-fb82feed8104', 'volume_name': 'volume-c7cc4721-1cac-4083-85f4-fb82feed8104', 'volume_size': 2}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc88a561-542f-4cfc-9914-09ecf465f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc88a561-542f-4cfc-9914-09ecf465f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ad163a-18d7-49e4-aea8-d33eb05859e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Volume c7cc4721-1cac-4083-85f4-fb82feed8104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7cc4721-1cac-4083-85f4-fb82feed8104', 'volume_size': 2}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1152511080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cc4721-1cac-4083-85f4-fb82feed8104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c27c466ae5f45d0b520241220f602ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:57:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:57:55Z,use_quota=True,user_id='0f8f9aa269e044e7ba0fc37c0501a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Creating volume c7cc4721-1cac-4083-85f4-fb82feed8104 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:57:54 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:57:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104 2147483648 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:55 devstack sudo[92382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104 2147483648
Nov 05 11:57:55 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:55 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706" returned: 0 in 0.553s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d72fa00-9c92-4d8e-a2ce-6519909f350b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:55 devstack sudo[92391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:55 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:55 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104 2147483648" returned: 0 in 0.878s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:55 devstack sudo[92395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104
Nov 05 11:57:55 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:56 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.674s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:56 devstack sudo[92400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706
Nov 05 11:57:56 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:56 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104" returned: 0 in 0.343s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ad163a-18d7-49e4-aea8-d33eb05859e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7cc4721-1cac-4083-85f4-fb82feed8104', 'volume_size': 2}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8879deb4-eadd-4c04-8cbc-6a9a57e549ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:57:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Volume volume-c7cc4721-1cac-4083-85f4-fb82feed8104 (c7cc4721-1cac-4083-85f4-fb82feed8104): created successfully
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8879deb4-eadd-4c04-8cbc-6a9a57e549ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Flow 'volume_create_manager' (5feedb97-7ec0-4f7a-ac60-681899b7a0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:57:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-04192477-ee93-4e4e-b585-0095e19f1fbc tempest-VolumesCloneNegativeTest-691384024 None] Created volume successfully.
Nov 05 11:57:56 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706" returned: 0 in 0.457s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:56 devstack sudo[92413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706
Nov 05 11:57:56 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:56 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.3bf509a5-8a32-4374-aa1f-e4043c75a706" returned: 0 in 0.330s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-3bf509a5-8a32-4374-aa1f-e4043c75a706" released by "_delete_snapshot" :: held 2.166s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" released by "delete_snapshot" :: held 2.200s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:56 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Created reservations ['04b76b3c-1988-40c8-ad2e-dbcc6c92db56', '367623ec-aee7-4029-ae1e-c604f9ab8e84', 'afddb8ef-85a4-4998-a065-fdbf79adf3df', 'f970865f-61a5-45fc-aa2b-34610c338f63'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Acquiring lock "cinder-c7cc4721-1cac-4083-85f4-fb82feed8104-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Delete snapshot completed successfully.
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Lock "cinder-c7cc4721-1cac-4083-85f4-fb82feed8104-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-efbe7b69-ce59-484d-8879-ddad4afc4e24 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-3bf509a5-8a32-4374-aa1f-e4043c75a706-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Acquiring lock "cinder-quobyte-c7cc4721-1cac-4083-85f4-fb82feed8104" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Lock "cinder-quobyte-c7cc4721-1cac-4083-85f4-fb82feed8104" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daaf97a-6e02-4967-8e31-bdbe7d2e58d5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:57 devstack sudo[92416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104
Nov 05 11:57:57 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:57 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104" returned: 0 in 0.399s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:57 devstack sudo[92421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104
Nov 05 11:57:57 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:57 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c7cc4721-1cac-4083-85f4-fb82feed8104" returned: 0 in 0.363s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Lock "cinder-quobyte-c7cc4721-1cac-4083-85f4-fb82feed8104" released by "delete_volume" :: held 0.820s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Created reservations ['28bc8ed1-ecfa-4a45-a254-38e8a77b8c37', '815183bb-0e3d-4ae4-91f6-d8221fa92227', '615ba2c0-8623-4dc9-83b2-e6b900b7d411', '15cd97d2-04e2-4fb3-8e54-9fb2e6bd1a9a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:58 devstack sudo[92424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:57:58 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Creating offline snapshot 027e9675-5e54-4103-84bb-20550a4e40ba of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[873f8d7b-8437-48e5-b72a-f7bfb9ee6ba2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:58 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.324s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:57:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Deleted volume successfully.
Nov 05 11:57:58 devstack sudo[92426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-97727d2a-f135-45ca-9ce8-78bbfbe1ae48 tempest-VolumesCloneNegativeTest-691384024 None] Lock "cinder-c7cc4721-1cac-4083-85f4-fb82feed8104-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:57:58 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:58 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.586s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:57:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:59 devstack sudo[92436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba 1G
Nov 05 11:57:59 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:57:59 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root
Nov 05 11:57:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba 1G" returned: 0 in 0.769s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:57:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:57:59 devstack sudo[92478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba
Nov 05 11:57:59 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:00 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba" returned: 0 in 0.433s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:00 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba is being set with open permissions: ugo+rw
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:00 devstack sudo[92487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba
Nov 05 11:58:00 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:00 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba" returned: 0 in 0.373s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:00 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-64d6be82-172e-4b29-b55f-ea004fc73910 tempest-SnapshotsActionsTest-1605373956 None] Create snapshot completed successfully
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-17bac77a-a43e-424f-b55d-a2933e200a0c req-658dd300-5dc6-47c8-82f4-d9c987a077c5 tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-17bac77a-a43e-424f-b55d-a2933e200a0c req-658dd300-5dc6-47c8-82f4-d9c987a077c5 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-17bac77a-a43e-424f-b55d-a2933e200a0c req-658dd300-5dc6-47c8-82f4-d9c987a077c5 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-17bac77a-a43e-424f-b55d-a2933e200a0c req-658dd300-5dc6-47c8-82f4-d9c987a077c5 tempest-ServerActionsTestOtherA-1509821086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-6d7e0517-b5d8-422d-9360-44205ec38a36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '143004e7-0fea-4a06-966b-f5c0082e9fbe', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:58:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-17bac77a-a43e-424f-b55d-a2933e200a0c req-658dd300-5dc6-47c8-82f4-d9c987a077c5 tempest-ServerActionsTestOtherA-1509821086 None] attachment_update completed successfully.
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-027e9675-5e54-4103-84bb-20550a4e40ba-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-027e9675-5e54-4103-84bb-20550a4e40ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Acquiring lock "cinder-quobyte-027e9675-5e54-4103-84bb-20550a4e40ba" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-027e9675-5e54-4103-84bb-20550a4e40ba" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Deleting offline snapshot 027e9675-5e54-4103-84bb-20550a4e40ba of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] snapshot_file for this snap is: volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b115557-8ccd-4be6-b4c1-e04914e613ed]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:02 devstack sudo[92917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba
Nov 05 11:58:02 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:02 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba" returned: 0 in 0.692s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:02 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e58999f-3609-47f1-89e3-8f0089ebbd02]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:02 devstack sudo[92924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:58:02 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:03 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.613s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:03 devstack sudo[92930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba
Nov 05 11:58:03 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:03 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba" returned: 0 in 0.615s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:03 devstack sudo[92947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba
Nov 05 11:58:03 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:04 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.027e9675-5e54-4103-84bb-20550a4e40ba" returned: 0 in 0.483s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-027e9675-5e54-4103-84bb-20550a4e40ba" released by "_delete_snapshot" :: held 2.568s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" released by "delete_snapshot" :: held 2.626s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:04 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Created reservations ['56acb765-9c6b-4cb5-b550-3e4a23279225', 'f5afcd31-5857-4f77-b723-b7d2ae5fcfb3', '00b6e981-9bd9-43f2-8f5c-c0de2b615da2', '1626b5cf-4b55-4ab1-8811-c5fad1d72a65'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Delete snapshot completed successfully.
Nov 05 11:58:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5bd14333-c713-4ced-821c-0f6d5a3faae4 tempest-SnapshotsActionsTest-766497381 None] Lock "cinder-027e9675-5e54-4103-84bb-20550a4e40ba-delete_snapshot" released by "delete_snapshot" :: held 2.918s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "cinder-dc8da3c2-6fa7-491a-b69b-0818cb66232e-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-dc8da3c2-6fa7-491a-b69b-0818cb66232e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "cinder-quobyte-dc8da3c2-6fa7-491a-b69b-0818cb66232e" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-quobyte-dc8da3c2-6fa7-491a-b69b-0818cb66232e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Deleting offline snapshot dc8da3c2-6fa7-491a-b69b-0818cb66232e of volume adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] snapshot_file for this snap is: volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8611f-eee7-4aaf-87aa-330ae105c335]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:06 devstack sudo[92963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:58:06 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-dd10769a-27c1-4e73-90c5-aa2a3268611d req-7e06ce0e-c8b7-4042-8a54-bdc21022180f tempest-ServerActionsTestOtherA-1509821086 None] Terminate volume connection completed successfully.
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-dd10769a-27c1-4e73-90c5-aa2a3268611d req-7e06ce0e-c8b7-4042-8a54-bdc21022180f tempest-ServerActionsTestOtherA-1509821086 None] Deleting attachment 143004e7-0fea-4a06-966b-f5c0082e9fbe. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:58:06 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.737s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b29725-f2ed-44fa-a0a8-3a325c7e7224]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:07 devstack sudo[93003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b
Nov 05 11:58:07 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:07 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b" returned: 0 in 0.724s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:07 devstack sudo[93024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:58:07 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-dd10769a-27c1-4e73-90c5-aa2a3268611d req-075ff131-c423-4720-a30d-b07d06a805b9 tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-dd10769a-27c1-4e73-90c5-aa2a3268611d req-075ff131-c423-4720-a30d-b07d06a805b9 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-dd10769a-27c1-4e73-90c5-aa2a3268611d req-075ff131-c423-4720-a30d-b07d06a805b9 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-dd10769a-27c1-4e73-90c5-aa2a3268611d req-075ff131-c423-4720-a30d-b07d06a805b9 tempest-ServerActionsTestOtherA-1509821086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-6d7e0517-b5d8-422d-9360-44205ec38a36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36b70adb-bd07-4a08-b06b-4aedb349c024', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:58:08 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.575s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:08 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-dd10769a-27c1-4e73-90c5-aa2a3268611d req-075ff131-c423-4720-a30d-b07d06a805b9 tempest-ServerActionsTestOtherA-1509821086 None] attachment_update completed successfully.
Nov 05 11:58:08 devstack sudo[93035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e
Nov 05 11:58:08 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:08 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b.dc8da3c2-6fa7-491a-b69b-0818cb66232e" returned: 0 in 0.496s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-quobyte-dc8da3c2-6fa7-491a-b69b-0818cb66232e" released by "_delete_snapshot" :: held 2.810s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" released by "delete_snapshot" :: held 2.855s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Created reservations ['14573a49-9e8a-4f3d-bfc5-1c8d76334ec9', '419f242e-b4aa-4a73-9f43-2bb4ebe15d0b', '6651bbce-f39c-4fe6-86e0-020e0d89d14f', 'aa7d4302-8679-4de4-81a6-995e2e29e90b'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:09 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Delete snapshot completed successfully.
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e44172e0-e4bc-4596-8b24-eee587e78768 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-dc8da3c2-6fa7-491a-b69b-0818cb66232e-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "cinder-adb83b78-9bc5-4215-a235-7bc5599c5e3b-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-adb83b78-9bc5-4215-a235-7bc5599c5e3b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfdd07a-beb0-4f1e-bd69-bdedadbda5e2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:09 devstack sudo[93049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b
Nov 05 11:58:09 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:10 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b" returned: 0 in 0.759s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:10 devstack sudo[93117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b
Nov 05 11:58:10 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:10 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-adb83b78-9bc5-4215-a235-7bc5599c5e3b" returned: 0 in 0.553s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-quobyte-adb83b78-9bc5-4215-a235-7bc5599c5e3b" released by "delete_volume" :: held 1.440s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Created reservations ['860d8c5f-02d1-44e9-baab-44eb73afb430', 'b1f7fddb-56bb-4aa3-9d33-a3b21f5cf251', 'a20d9610-b4e9-405f-91ab-1b3e5537e3e5', '45eea6a9-cb80-4333-b84f-9b78aaa5bce7'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:11 devstack sudo[93230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:58:11 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:11 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.434s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Deleted volume successfully.
Nov 05 11:58:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66432358-9f27-4a6b-a932-edb6a8014185 tempest-SnapshotsActionsTest-1605373956 None] Lock "cinder-adb83b78-9bc5-4215-a235-7bc5599c5e3b-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:58:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:13 devstack sudo[93584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:58:13 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:14 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.884s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:58:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 8 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:58:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:58:21 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=62,cinder:INSERT=18,cinder:SELECT=58,cinder:DELETE=5 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:58:21 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=71,cinder:SELECT=69,cinder:DELETE=4,cinder:INSERT=16 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (32f7a679-4250-4c63-92bf-03a94d7f264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d063b-13d0-4a9e-814a-06e66fdfbff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d063b-13d0-4a9e-814a-06e66fdfbff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1557393232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629457ea-c11f-473c-8f0e-e9ff82e9f7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:26Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecaeefc-166f-499e-be93-5c7b3e17cf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecaeefc-166f-499e-be93-5c7b3e17cf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521c008f-2e45-49cd-8af5-9c371c947c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521c008f-2e45-49cd-8af5-9c371c947c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629457ea-c11f-473c-8f0e-e9ff82e9f7d8', 'volume_name': 'volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb0e925-0cb7-4fcf-81b0-640947fa9147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb0e925-0cb7-4fcf-81b0-640947fa9147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8601f5fb-4b17-4929-8f9c-b75cd47a5ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:26 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Volume 629457ea-c11f-473c-8f0e-e9ff82e9f7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8', 'volume_size': 1}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1557393232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629457ea-c11f-473c-8f0e-e9ff82e9f7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:26Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Creating volume 629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:26 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:58:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:26 devstack sudo[93611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 1073741824
Nov 05 11:58:26 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:27 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 1073741824" returned: 0 in 0.545s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:27 devstack sudo[93642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8
Nov 05 11:58:27 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:27 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" returned: 0 in 0.322s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8601f5fb-4b17-4929-8f9c-b75cd47a5ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0399e45a-fbd0-4790-b35a-73ec5a542a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Volume volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 (629457ea-c11f-473c-8f0e-e9ff82e9f7d8): created successfully
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0399e45a-fbd0-4790-b35a-73ec5a542a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (32f7a679-4250-4c63-92bf-03a94d7f264a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-777f1b26-bf5c-4810-9d0d-3fd2ce56aa5f tempest-VolumesSnapshotTestJSON-1430513968 None] Created volume successfully.
Nov 05 11:58:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Creating offline snapshot 9eae6883-1c3f-44ca-bef9-1847ea2f2e78 of volume 629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:58:28 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e72500-c2a9-432a-90de-ba0600fecce9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:28 devstack sudo[93645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8
Nov 05 11:58:28 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:29 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" returned: 0 in 0.421s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:29 devstack sudo[93673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 1G
Nov 05 11:58:29 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:29 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 1G" returned: 0 in 0.546s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:29 devstack sudo[93679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78
Nov 05 11:58:29 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:30 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78" returned: 0 in 0.347s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:30 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 is being set with open permissions: ugo+rw
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:30 devstack sudo[93684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78
Nov 05 11:58:30 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:30 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:30 devstack sudo[93687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.info
Nov 05 11:58:30 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:30 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.info" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:30 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.info is being set with open permissions: ugo+rw
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:30 devstack sudo[93714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.info
Nov 05 11:58:30 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:30 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.info" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a473cad3-94ac-48d3-a15b-e4079cb8c815 tempest-VolumesSnapshotTestJSON-1430513968 None] Create snapshot completed successfully
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-9eae6883-1c3f-44ca-bef9-1847ea2f2e78-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-9eae6883-1c3f-44ca-bef9-1847ea2f2e78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-9eae6883-1c3f-44ca-bef9-1847ea2f2e78" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-9eae6883-1c3f-44ca-bef9-1847ea2f2e78" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Deleting offline snapshot 9eae6883-1c3f-44ca-bef9-1847ea2f2e78 of volume 629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] snapshot_file for this snap is: volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[583c2e69-94f0-4623-801f-9388156c8db3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:32 devstack sudo[93717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78
Nov 05 11:58:32 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:32 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78" returned: 0 in 0.479s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a02b98-536e-4698-86c9-55ca75dc779c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:32 devstack sudo[93722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8
Nov 05 11:58:32 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:33 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" returned: 0 in 0.471s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:33 devstack sudo[93727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78
Nov 05 11:58:33 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:33 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78" returned: 0 in 0.450s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:33 devstack sudo[93733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78
Nov 05 11:58:33 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:33 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8.9eae6883-1c3f-44ca-bef9-1847ea2f2e78" returned: 0 in 0.347s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-9eae6883-1c3f-44ca-bef9-1847ea2f2e78" released by "_delete_snapshot" :: held 1.917s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" released by "delete_snapshot" :: held 1.947s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:34 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['e1071d15-bbb4-4f16-9c12-307470302b02', '0aab34d3-68f3-470a-99c5-b7817f596555', 'be51f5f0-af7b-4ace-97d6-692c1598a1ba', 'f01858bf-b6b1-44c8-bb31-1bc24649a17c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Delete snapshot completed successfully.
Nov 05 11:58:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-786b6fc7-5a83-425c-9123-f57a1cc70a2b tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-9eae6883-1c3f-44ca-bef9-1847ea2f2e78-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (36895d72-7f9e-4bdd-bdf6-7c9e293b0ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9f5b6-8cfd-424d-8148-e3079ed56551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9f5b6-8cfd-424d-8148-e3079ed56551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-245995492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:36Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41643f8-73a7-4bd9-b629-e3ff526abb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41643f8-73a7-4bd9-b629-e3ff526abb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840e47b3-311f-4909-b039-ffa53d1abaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840e47b3-311f-4909-b039-ffa53d1abaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17', 'volume_name': 'volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73227bdf-5cca-4de3-8e30-436b7c9c0855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73227bdf-5cca-4de3-8e30-436b7c9c0855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10493fed-9b3a-44be-b5c7-0dd69fc596f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:35 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Volume 6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17', 'volume_size': 1}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-245995492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:36Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Creating volume 6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:35 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:58:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:35 devstack sudo[93736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 1073741824
Nov 05 11:58:35 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:36 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 1073741824" returned: 0 in 0.506s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:36 devstack sudo[93742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17
Nov 05 11:58:36 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:36 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" returned: 0 in 0.349s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10493fed-9b3a-44be-b5c7-0dd69fc596f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7cb556-094d-4714-8544-deaa212be793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:36 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Volume volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 (6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17): created successfully
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7cb556-094d-4714-8544-deaa212be793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (36895d72-7f9e-4bdd-bdf6-7c9e293b0ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:36 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-18002211-92e0-42de-a742-905f3d02bbbd tempest-VolumesSnapshotTestJSON-1430513968 None] Created volume successfully.
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Flow 'volume_create_manager' (38652b58-3b4e-4b0e-91f3-eb7e5fc186ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360f49c9-94c7-4144-b759-ca2185767611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360f49c9-94c7-4144-b759-ca2185767611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1473195933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfef3538-e128-4659-a9ef-8941a278e08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff14413af8ed4404bebf716fa9b794e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:37Z,use_quota=True,user_id='aa538998107c42d2ab774d82cd3aea3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f68ef82-8394-4550-9a02-1ec992a403bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f68ef82-8394-4550-9a02-1ec992a403bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaa9645-3f75-45ad-987f-2c6515d09a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaa9645-3f75-45ad-987f-2c6515d09a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfef3538-e128-4659-a9ef-8941a278e08e', 'volume_name': 'volume-cfef3538-e128-4659-a9ef-8941a278e08e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4a391f-15bf-4542-a79a-2d6cc7a946c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4a391f-15bf-4542-a79a-2d6cc7a946c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e120e7-dbc9-435c-89a8-9d4c0cf42b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Volume cfef3538-e128-4659-a9ef-8941a278e08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfef3538-e128-4659-a9ef-8941a278e08e', 'volume_size': 1}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1473195933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfef3538-e128-4659-a9ef-8941a278e08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff14413af8ed4404bebf716fa9b794e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:37Z,use_quota=True,user_id='aa538998107c42d2ab774d82cd3aea3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Creating volume cfef3538-e128-4659-a9ef-8941a278e08e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:37 devstack sudo[93745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e 1073741824
Nov 05 11:58:37 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:37 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e 1073741824" returned: 0 in 0.477s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:37 devstack sudo[93750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e
Nov 05 11:58:37 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:37 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e120e7-dbc9-435c-89a8-9d4c0cf42b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfef3538-e128-4659-a9ef-8941a278e08e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2da8704-6ab3-4429-afd1-dee8e36ff011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Volume volume-cfef3538-e128-4659-a9ef-8941a278e08e (cfef3538-e128-4659-a9ef-8941a278e08e): created successfully
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2da8704-6ab3-4429-afd1-dee8e36ff011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Flow 'volume_create_manager' (38652b58-3b4e-4b0e-91f3-eb7e5fc186ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b05002d5-67c2-4b7d-ac1a-b4ff52a4bf2b tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Created volume successfully.
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Creating offline snapshot e14f960a-0b55-4aa6-b70e-5978636abd56 of volume 6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[658be7c6-7359-4ee5-8f6b-730de3ba621e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:38 devstack sudo[93753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17
Nov 05 11:58:38 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:38 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" returned: 0 in 0.416s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:38 devstack sudo[93758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 1G
Nov 05 11:58:38 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 1G" returned: 0 in 0.438s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:39 devstack sudo[93765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56
Nov 05 11:58:39 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56" returned: 0 in 0.387s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:39 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 is being set with open permissions: ugo+rw
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:39 devstack sudo[93771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56
Nov 05 11:58:39 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56" returned: 0 in 0.361s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:39 devstack sudo[93776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.info
Nov 05 11:58:39 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Flow 'volume_create_manager' (56d11ec3-5c9a-46c4-94f2-656506e9aaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c86751-0ba7-4ad9-9c31-939b5771cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c86751-0ba7-4ad9-9c31-939b5771cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-15492117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c25a3b6-0f4f-4b2a-8e35-884bb4129225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea507c70a15446cb980c504c59da073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:40Z,use_quota=True,user_id='89436e30ae544a24b3779a942061b23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529ea4aa-02ad-4a1d-aa90-53b3cea497d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529ea4aa-02ad-4a1d-aa90-53b3cea497d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321aadd2-7c6e-404d-aac7-10e42c4e84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321aadd2-7c6e-404d-aac7-10e42c4e84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c25a3b6-0f4f-4b2a-8e35-884bb4129225', 'volume_name': 'volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a3e3c4-1d62-42ab-8d5b-bb4209c5fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a3e3c4-1d62-42ab-8d5b-bb4209c5fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029ddf85-b70d-4d85-8dda-443450e359e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:40 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Volume 4c25a3b6-0f4f-4b2a-8e35-884bb4129225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225', 'volume_size': 1}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:40 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.info" returned: 0 in 0.317s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:40 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.info is being set with open permissions: ugo+rw
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:40 devstack sudo[93779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.info
Nov 05 11:58:40 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:40 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.info" returned: 0 in 0.303s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-15492117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c25a3b6-0f4f-4b2a-8e35-884bb4129225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea507c70a15446cb980c504c59da073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:40Z,use_quota=True,user_id='89436e30ae544a24b3779a942061b23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Creating volume 4c25a3b6-0f4f-4b2a-8e35-884bb4129225 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:40 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:40 devstack sudo[93783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225 1073741824
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Acquiring lock "cinder-cfef3538-e128-4659-a9ef-8941a278e08e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:40 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "cinder-cfef3538-e128-4659-a9ef-8941a278e08e-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-49d91155-925a-4b5a-8c68-f816c25f4239 tempest-VolumesSnapshotTestJSON-1430513968 None] Create snapshot completed successfully
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Acquiring lock "cinder-quobyte-cfef3538-e128-4659-a9ef-8941a278e08e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "cinder-quobyte-cfef3538-e128-4659-a9ef-8941a278e08e" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485a2e1-ee89-426d-ab8e-1b2cb5a9c9ba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:40 devstack sudo[93785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e
Nov 05 11:58:40 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-24dfcaa1-be1c-4159-92c9-bb52a743b6e7 req-27ff7d46-e4b9-4a8f-a426-b895f22d6bdd tempest-ServerActionsTestOtherA-1509821086 None] Terminate volume connection completed successfully.
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-24dfcaa1-be1c-4159-92c9-bb52a743b6e7 req-27ff7d46-e4b9-4a8f-a426-b895f22d6bdd tempest-ServerActionsTestOtherA-1509821086 None] Deleting attachment 36b70adb-bd07-4a08-b06b-4aedb349c024. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:58:41 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225 1073741824" returned: 0 in 0.560s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:41 devstack sudo[93797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225
Nov 05 11:58:41 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:41 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e" returned: 0 in 0.461s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:41 devstack sudo[93799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e
Nov 05 11:58:41 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:41 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029ddf85-b70d-4d85-8dda-443450e359e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e474020-9a73-4678-9cb0-d35679190b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:41 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Volume volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225 (4c25a3b6-0f4f-4b2a-8e35-884bb4129225): created successfully
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e474020-9a73-4678-9cb0-d35679190b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Flow 'volume_create_manager' (56d11ec3-5c9a-46c4-94f2-656506e9aaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-80790239-ade2-4df6-9999-0d2340029e3d tempest-AttachVolumeNegativeTest-1143206013 None] Created volume successfully.
Nov 05 11:58:41 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cfef3538-e128-4659-a9ef-8941a278e08e" returned: 0 in 0.285s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "cinder-quobyte-cfef3538-e128-4659-a9ef-8941a278e08e" released by "delete_volume" :: held 0.802s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Created reservations ['ba427cbb-28d8-4ff9-8249-1bfd8b3d6a26', 'a5489f2a-90ed-442c-ada5-291d8ebc6818', 'e380c7e8-a9b9-42ea-b6a4-5c4ec5fe4c19', 'ebb205f4-2886-42fc-a979-98a06f65e2e9'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:41 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:58:41 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:42 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.451s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Deleted volume successfully.
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d765f7ad-301e-4b44-b670-7e449705bc14 tempest-VolumeQuotasNegativeTestJSON-1716487081 None] Lock "cinder-cfef3538-e128-4659-a9ef-8941a278e08e-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (edcb2cde-5381-4112-b75b-615d69ac934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0fb6be-b15f-4fc2-be23-acf66f43abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0fb6be-b15f-4fc2-be23-acf66f43abce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-528154333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c2a818-d5a1-4e6d-917f-90a477e8bb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e14f960a-0b55-4aa6-b70e-5978636abd56,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:42Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aaa4f08-37ee-4f4e-b462-6a198b9f9146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aaa4f08-37ee-4f4e-b462-6a198b9f9146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d199fc-aa96-494d-b7e3-2f708ad3df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d199fc-aa96-494d-b7e3-2f708ad3df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7c2a818-d5a1-4e6d-917f-90a477e8bb06', 'volume_name': 'volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06', 'volume_size': 2, 'snapshot_id': 'e14f960a-0b55-4aa6-b70e-5978636abd56'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd375b5c-4dfc-439c-8122-f736813f33e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd375b5c-4dfc-439c-8122-f736813f33e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb0f81e-b669-475d-89f7-828fa86df698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Volume e7c2a818-d5a1-4e6d-917f-90a477e8bb06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06', 'volume_size': 2, 'snapshot_id': 'e14f960a-0b55-4aa6-b70e-5978636abd56'}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-e14f960a-0b55-4aa6-b70e-5978636abd56-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e14f960a-0b55-4aa6-b70e-5978636abd56-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Creating volume e7c2a818-d5a1-4e6d-917f-90a477e8bb06 from snapshot e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] snapshot: e14f960a-0b55-4aa6-b70e-5978636abd56, volume: e7c2a818-d5a1-4e6d-917f-90a477e8bb06,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8d0267-7039-4a1f-80e5-b5acc01efad8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:42 devstack sudo[93820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56
Nov 05 11:58:42 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:43 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56" returned: 0 in 0.548s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df42dcd-9899-4815-891b-b288ed070b97]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:43 devstack sudo[93839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17
Nov 05 11:58:43 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:43 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" returned: 0 in 0.665s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:43 devstack sudo[93854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06
Nov 05 11:58:43 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-50e6ea45-11c7-4718-ad6a-299421d2adf0 req-4e2e926e-f2d8-4484-94f5-181e27f4f057 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Flow 'volume_create_manager' (1869fee4-21e9-43df-9cc2-918f8cfefc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b23630-d132-4b5d-9464-18c7424a6b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b23630-d132-4b5d-9464-18c7424a6b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2093337359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd67012c-28a7-4f64-a998-adff957cd561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539e6144c4a0434aba55148e74c1977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:52Z,use_quota=True,user_id='d02532ab6c3b48e4bec780016065756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bb9b7c-b4bf-4d8a-a1fb-6e3984b20a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bb9b7c-b4bf-4d8a-a1fb-6e3984b20a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db355de-f464-414c-8888-981949b3ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 11:58:52 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" returned: 0 in 8.850s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17, size 1024.00 MB, duration 8.85 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:58:52 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Converted 1024.00 MB image at 115.68 MB/s
Nov 05 11:58:52 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 is being set with open permissions: ugo+rw
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:52 devstack sudo[93885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06
Nov 05 11:58:52 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:52 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" returned: 0 in 0.288s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" released by "_copy_volume_from_snapshot" :: held 10.504s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e14f960a-0b55-4aa6-b70e-5978636abd56-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" released by "_create_volume_from_snapshot" :: held 10.613s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.647s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-50e6ea45-11c7-4718-ad6a-299421d2adf0 req-4e2e926e-f2d8-4484-94f5-181e27f4f057 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.122s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-50e6ea45-11c7-4718-ad6a-299421d2adf0 req-4e2e926e-f2d8-4484-94f5-181e27f4f057 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb0f81e-b669-475d-89f7-828fa86df698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06', 'volume_size': 2, 'snapshot_id': 'e14f960a-0b55-4aa6-b70e-5978636abd56'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e652e0ca-124f-4083-a49b-a384c22398cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:53 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Volume volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 (e7c2a818-d5a1-4e6d-917f-90a477e8bb06): created successfully
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e652e0ca-124f-4083-a49b-a384c22398cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (edcb2cde-5381-4112-b75b-615d69ac934b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-50e6ea45-11c7-4718-ad6a-299421d2adf0 req-4e2e926e-f2d8-4484-94f5-181e27f4f057 tempest-AttachVolumeNegativeTest-1143206013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c813c561-015a-4d00-bd11-384f06794015', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:58:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d418b915-5765-4dac-a2f2-37644ac039c0 tempest-VolumesSnapshotTestJSON-1430513968 None] Created volume successfully.
Nov 05 11:58:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-50e6ea45-11c7-4718-ad6a-299421d2adf0 req-4e2e926e-f2d8-4484-94f5-181e27f4f057 tempest-AttachVolumeNegativeTest-1143206013 None] attachment_update completed successfully.
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db355de-f464-414c-8888-981949b3ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd67012c-28a7-4f64-a998-adff957cd561', 'volume_name': 'volume-fd67012c-28a7-4f64-a998-adff957cd561', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028ef10d0>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbec923-979f-4e31-a6b3-fb8ddadef574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbec923-979f-4e31-a6b3-fb8ddadef574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a04cfd-b67d-4248-b168-e830b6a95465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:58:53 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Volume fd67012c-28a7-4f64-a998-adff957cd561: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd67012c-28a7-4f64-a998-adff957cd561', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028ef10d0>}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Trying to clone fd67012c-28a7-4f64-a998-adff957cd561 from image 71120f13-1140-4938-836f-6085e103efeb at location (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-e7c2a818-d5a1-4e6d-917f-90a477e8bb06-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-e7c2a818-d5a1-4e6d-917f-90a477e8bb06-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" acquired by "delete_volume" :: waited 0.041s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf565ae-7c95-4b9c-8458-b57f400c6ce0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:53 devstack sudo[94324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06
Nov 05 11:58:53 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:53 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 11:58:53 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08d184e-d19e-472f-ad3f-1c8b788ce528]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:54 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD
Nov 05 11:58:54 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:54 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" returned: 0 in 0.506s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:54 devstack sudo[94332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06
Nov 05 11:58:54 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:54 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb is fetched for user d02532ab6c3b48e4bec780016065756e. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 11:58:54 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" returned: 0 in 0.341s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e7c2a818-d5a1-4e6d-917f-90a477e8bb06" released by "delete_volume" :: held 0.963s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91041b7-ec46-4e24-91aa-83c36fd46edc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['999dec25-6424-4356-8a7a-b17d164d2484', 'a5f5ca04-1c2f-4054-9b8a-b8f6f5ac2d42', '1c23d847-56bb-4616-aefe-31789057c05e', '22fd797f-a063-4f5a-8ab5-dbd1508bf71f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:54 devstack sudo[94341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD
Nov 05 11:58:54 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:54 devstack sudo[94343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:58:54 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:55 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2093337359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd67012c-28a7-4f64-a998-adff957cd561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539e6144c4a0434aba55148e74c1977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:58:52Z,use_quota=True,user_id='d02532ab6c3b48e4bec780016065756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Creating volume fd67012c-28a7-4f64-a998-adff957cd561 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:58:55 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:55 devstack sudo[94349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 1073741824
Nov 05 11:58:55 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:55 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.315s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:58:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Deleted volume successfully.
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8583070f-3259-4c8b-a107-c1d424e9ac7f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-e7c2a818-d5a1-4e6d-917f-90a477e8bb06-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:55 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 1073741824" returned: 0 in 0.574s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:55 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561
Nov 05 11:58:55 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-e14f960a-0b55-4aa6-b70e-5978636abd56-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-e14f960a-0b55-4aa6-b70e-5978636abd56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-e14f960a-0b55-4aa6-b70e-5978636abd56" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e14f960a-0b55-4aa6-b70e-5978636abd56" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Deleting offline snapshot e14f960a-0b55-4aa6-b70e-5978636abd56 of volume 6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] snapshot_file for this snap is: volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[92224004-9c54-49c6-b46e-18b68e8f6815]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:56 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561" returned: 0 in 0.373s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Attempting download of 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume fd67012c-28a7-4f64-a998-adff957cd561. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d56fc00-d76e-4181-9a26-c2946ef7d29d]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_6tnu091s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:56 devstack sudo[94359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56
Nov 05 11:58:56 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:56 devstack sudo[94364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_6tnu091s
Nov 05 11:58:56 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:56 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56" returned: 0 in 0.489s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc003fa9-5d7c-4983-a25b-3856aabedefd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:56 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_6tnu091s" returned: 0 in 0.523s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_6tnu091s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:56 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17
Nov 05 11:58:56 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:56 devstack sudo[94375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_6tnu091s
Nov 05 11:58:56 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:57 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_6tnu091s" returned: 1 in 0.440s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_6tnu091s' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5008ca0f-07dc-4cff-a55b-d52dc0573eba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:57 devstack sudo[94382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD
Nov 05 11:58:57 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:57 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" returned: 0 in 0.730s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:57 devstack sudo[94385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56
Nov 05 11:58:57 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:57 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] 71120f13-1140-4938-836f-6085e103efeb was qcow2, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:57 devstack sudo[94394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561
Nov 05 11:58:57 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:57 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56" returned: 0 in 0.531s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:57 devstack sudo[94396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56
Nov 05 11:58:57 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:58:58 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root
Nov 05 11:58:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17.e14f960a-0b55-4aa6-b70e-5978636abd56" returned: 0 in 0.357s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:58:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-e14f960a-0b55-4aa6-b70e-5978636abd56" released by "_delete_snapshot" :: held 2.280s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" released by "delete_snapshot" :: held 2.318s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:58 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['ce58c4de-1e6c-442f-bd07-b2a1924f3d63', 'bf246110-8c96-458b-aab8-7bf0873d62de', '77eb3724-23d1-427a-92af-c909d00e5a49', 'adc72e05-a4c4-4f1c-b785-e9c30f58cff8'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:58:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Delete snapshot completed successfully.
Nov 05 11:58:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1f610d07-e4a2-4589-b51e-d908c60b1780 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-e14f960a-0b55-4aa6-b70e-5978636abd56-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:58:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:58:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:58:59 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e0f690-79fc-4844-a9f4-94be561d5ee4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:58:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:58:59 devstack sudo[94407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17
Nov 05 11:58:59 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:00 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" returned: 0 in 0.573s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:00 devstack sudo[94449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17
Nov 05 11:59:00 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:00 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" returned: 0 in 0.527s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17" released by "delete_volume" :: held 1.200s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:00 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['68b40e6c-3252-40ff-a98f-cd98a472e5f7', 'e44df62c-27a0-41f3-b311-d678ba860831', '4b0cabd6-e989-4867-a7a0-76caf1e6d57c', '84b58c67-bf07-45c1-ad20-80fc5635e855'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561" returned: 0 in 2.996s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_4dtm6q9ddevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:59:00 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Converted 112.00 MB image at 37.37 MB/s
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:00 devstack sudo[94454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 1G
Nov 05 11:59:00 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:00 devstack sudo[94456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:59:00 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:01 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.446s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:01 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 1G" returned: 0 in 0.571s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Downloaded image 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume fd67012c-28a7-4f64-a998-adff957cd561 successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb for user d02532ab6c3b48e4bec780016065756e is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Marking volume fd67012c-28a7-4f64-a998-adff957cd561 as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 11:59:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Deleted volume successfully.
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Copying metadata from image 71120f13-1140-4938-836f-6085e103efeb to fd67012c-28a7-4f64-a998-adff957cd561. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Creating volume glance metadata for volume fd67012c-28a7-4f64-a998-adff957cd561 backed by image 71120f13-1140-4938-836f-6085e103efeb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e36ef56d-0f8d-4630-a9b3-0042a4aff681 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-6dfdf065-c8a5-4bc4-a3ef-0faedb03bb17-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a04cfd-b67d-4248-b168-e830b6a95465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd67012c-28a7-4f64-a998-adff957cd561', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028ef10d0>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff108bef-c662-4b53-a5c5-cbf88ee28582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:01 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Volume volume-fd67012c-28a7-4f64-a998-adff957cd561 (fd67012c-28a7-4f64-a998-adff957cd561): created successfully
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff108bef-c662-4b53-a5c5-cbf88ee28582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Flow 'volume_create_manager' (1869fee4-21e9-43df-9cc2-918f8cfefc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cc4433e3-5502-4bbd-bc8b-1de908817c06 tempest-ServerActionsTestOtherA-1509821086 None] Created volume successfully.
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (300db67e-c410-4200-8cf9-b876d3de6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f7d83c-809c-4caf-a572-8a4d2c43c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f7d83c-809c-4caf-a572-8a4d2c43c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1312937524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5c717f-20da-4219-b673-8971a52010f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:02Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5978c7-a80b-4365-ae63-211b6377b653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5978c7-a80b-4365-ae63-211b6377b653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2383349a-fe71-41e4-b24d-c0c80f0c591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2383349a-fe71-41e4-b24d-c0c80f0c591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5c717f-20da-4219-b673-8971a52010f4', 'volume_name': 'volume-1b5c717f-20da-4219-b673-8971a52010f4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcf0d23-fa41-4ba3-90f7-83d8eda9e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcf0d23-fa41-4ba3-90f7-83d8eda9e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69ee865-cd8b-493f-b44d-f2ee5a3253ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:02 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Volume 1b5c717f-20da-4219-b673-8971a52010f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5c717f-20da-4219-b673-8971a52010f4', 'volume_size': 1}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1312937524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5c717f-20da-4219-b673-8971a52010f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:02Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Creating volume 1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:59:02 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:59:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:02 devstack sudo[94479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 1073741824
Nov 05 11:59:02 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Flow 'volume_create_manager' (1e9822a4-573e-4938-9982-bb947178fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eea4ff-0be6-4b75-8865-46e10b091a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9eea4ff-0be6-4b75-8865-46e10b091a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1666410820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cad9d7-8e39-4f65-a8c7-7b3a63d06142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0445c45027bc4690b81fa3595e4d6c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:03Z,use_quota=True,user_id='c0f1b4fcbee04ce0845f2f8fb3f14afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06b11eb-f870-401d-b84d-3967f7d5577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:03 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06b11eb-f870-401d-b84d-3967f7d5577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2262c3-a61d-4258-bb9a-d2ea9b9147ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 1073741824" returned: 0 in 0.736s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:03 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4
Nov 05 11:59:03 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:03 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2262c3-a61d-4258-bb9a-d2ea9b9147ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52cad9d7-8e39-4f65-a8c7-7b3a63d06142', 'volume_name': 'volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028ef2c90>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e651bf77-a71e-4d9c-9ae6-63bc650a4519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e651bf77-a71e-4d9c-9ae6-63bc650a4519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7efee-aaa9-464f-8216-22ac935e1c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Volume 52cad9d7-8e39-4f65-a8c7-7b3a63d06142: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028ef2c90>}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Trying to clone 52cad9d7-8e39-4f65-a8c7-7b3a63d06142 from image 71120f13-1140-4938-836f-6085e103efeb at location (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4" returned: 0 in 0.337s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69ee865-cd8b-493f-b44d-f2ee5a3253ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5c717f-20da-4219-b673-8971a52010f4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4d42b8-1508-4be1-b4d5-824117763d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Volume volume-1b5c717f-20da-4219-b673-8971a52010f4 (1b5c717f-20da-4219-b673-8971a52010f4): created successfully
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4d42b8-1508-4be1-b4d5-824117763d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (300db67e-c410-4200-8cf9-b876d3de6f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-288be480-0ddc-4b41-b5a7-5c44cee162e3 tempest-VolumesSnapshotTestJSON-1430513968 None] Created volume successfully.
Nov 05 11:59:04 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 11:59:04 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 11:59:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc5a7e0-d975-4359-93f2-f5c56550a5d4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:04 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD
Nov 05 11:59:04 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Creating offline snapshot a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e of volume 1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[18466520-dbd5-461d-a537-7367edcfd26e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:05 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD" returned: 0 in 0.620s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb is fetched for user c0f1b4fcbee04ce0845f2f8fb3f14afe. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01a4403-b4b9-41dd-a939-5caf3c0a830d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:05 devstack sudo[94508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4
Nov 05 11:59:05 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:05 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD
Nov 05 11:59:05 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:06 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4" returned: 0 in 1.004s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:06 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:06 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e 1G
Nov 05 11:59:06 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:06 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e 1G" returned: 0 in 0.772s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5c717f-20da-4219-b673-8971a52010f4 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:06 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5c717f-20da-4219-b673-8971a52010f4 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e
Nov 05 11:59:06 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f00e5a9e-88a2-44f4-b03d-1b98e149a6a6 req-6103453e-1ae8-48c6-a24e-24835da5b1e3 tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:07 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5c717f-20da-4219-b673-8971a52010f4 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" returned: 0 in 0.676s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:07 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e is being set with open permissions: ugo+rw
Nov 05 11:59:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:07 devstack sudo[94574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e
Nov 05 11:59:07 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:08 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" returned: 0 in 0.504s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:08 devstack sudo[94577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.info
Nov 05 11:59:08 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:08 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.info" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:08 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.info is being set with open permissions: ugo+rw
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:08 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.info
Nov 05 11:59:08 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:08 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.info" returned: 0 in 0.291s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.801s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.681s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1666410820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cad9d7-8e39-4f65-a8c7-7b3a63d06142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0445c45027bc4690b81fa3595e4d6c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:03Z,use_quota=True,user_id='c0f1b4fcbee04ce0845f2f8fb3f14afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Creating volume 52cad9d7-8e39-4f65-a8c7-7b3a63d06142 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:59:08 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:59:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:08 devstack sudo[94583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 1073741824
Nov 05 11:59:08 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:08 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-74d53575-b232-4265-aa87-6bb140769f4a tempest-VolumesSnapshotTestJSON-1430513968 None] Create snapshot completed successfully
Nov 05 11:59:09 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 1073741824" returned: 0 in 0.879s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:09 devstack sudo[94590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142
Nov 05 11:59:09 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:10 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142" returned: 0 in 0.612s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f00e5a9e-88a2-44f4-b03d-1b98e149a6a6 req-6103453e-1ae8-48c6-a24e-24835da5b1e3 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.090s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f00e5a9e-88a2-44f4-b03d-1b98e149a6a6 req-6103453e-1ae8-48c6-a24e-24835da5b1e3 tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.098s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Attempting download of 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume 52cad9d7-8e39-4f65-a8c7-7b3a63d06142. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-f00e5a9e-88a2-44f4-b03d-1b98e149a6a6 req-6103453e-1ae8-48c6-a24e-24835da5b1e3 tempest-ServerActionsTestOtherA-1509821086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-fd67012c-28a7-4f64-a998-adff957cd561', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1353363b-8835-4b7d-a0e3-f9e34575b9e5', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (1ba17673-4ad4-4e5d-baad-c2c82a494b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b2da1b-04b0-49a6-a14f-9445bada6560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad89f131-a3b2-44b8-8f67-c4771b229eeb]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_qojz5gye {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b2da1b-04b0-49a6-a14f-9445bada6560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2096653095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7049e652-61b9-40d2-b6dc-809623e942bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd617d5c9284705ab7f9ec33dec65c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:10Z,use_quota=True,user_id='8a3dbf11ebc84775985c148aa501668f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90db1337-aacd-4c32-babc-abc8a5b12096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90db1337-aacd-4c32-babc-abc8a5b12096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af8a6bb-054f-4b6c-909e-94177a9dc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af8a6bb-054f-4b6c-909e-94177a9dc275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7049e652-61b9-40d2-b6dc-809623e942bd', 'volume_name': 'volume-7049e652-61b9-40d2-b6dc-809623e942bd', 'volume_size': 1, 'snapshot_id': 'a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4663a-4846-456d-bf34-ecbb4cd29031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4663a-4846-456d-bf34-ecbb4cd29031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823e769e-c5a5-4192-810f-317167ebdca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:10 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Volume 7049e652-61b9-40d2-b6dc-809623e942bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7049e652-61b9-40d2-b6dc-809623e942bd', 'volume_size': 1, 'snapshot_id': 'a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e'}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e-7049e652-61b9-40d2-b6dc-809623e942bd" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e-7049e652-61b9-40d2-b6dc-809623e942bd" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Creating volume 7049e652-61b9-40d2-b6dc-809623e942bd from snapshot a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-7049e652-61b9-40d2-b6dc-809623e942bd" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:10 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-f00e5a9e-88a2-44f4-b03d-1b98e149a6a6 req-6103453e-1ae8-48c6-a24e-24835da5b1e3 tempest-ServerActionsTestOtherA-1509821086 None] attachment_update completed successfully.
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-7049e652-61b9-40d2-b6dc-809623e942bd" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] snapshot: a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e, volume: 7049e652-61b9-40d2-b6dc-809623e942bd,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 11:59:10 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_qojz5gye
Nov 05 11:59:10 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4824e2-0863-4988-bb15-955c62146d2a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:11 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e
Nov 05 11:59:11 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:11 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_qojz5gye" returned: 0 in 0.694s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_qojz5gye {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:11 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" returned: 0 in 0.674s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5c717f-20da-4219-b673-8971a52010f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:59:11 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[37beee62-3bc6-484c-932a-c401f328c5a9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:11 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_qojz5gye
Nov 05 11:59:11 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:12 devstack sudo[94606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4
Nov 05 11:59:12 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:12 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_qojz5gye" returned: 1 in 1.074s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_qojz5gye' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[988e879a-997c-4b2a-b74b-f229ab93b2c8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:12 devstack sudo[94636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD
Nov 05 11:59:12 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:12 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4" returned: 0 in 1.150s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 11:59:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:12 devstack sudo[94649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd
Nov 05 11:59:12 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:13 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] 71120f13-1140-4938-836f-6085e103efeb was qcow2, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:13 devstack sudo[94662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142
Nov 05 11:59:13 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:13 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:59:13 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:14 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.965s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 11:59:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 11:59:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 11:59:20 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=84,cinder:UPDATE=76,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:20 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=61,cinder:INSERT=29,cinder:DELETE=5,cinder:SELECT=85 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 11:59:22 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142" returned: 0 in 9.242s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:22 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_e6su_mkkdevstack@QuobyteHD, size 112.00 MB, duration 9.24 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:59:22 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Converted 112.00 MB image at 12.12 MB/s
Nov 05 11:59:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:22 devstack sudo[94747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 1G
Nov 05 11:59:22 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:23 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 1G" returned: 0 in 0.837s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Downloaded image 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume 52cad9d7-8e39-4f65-a8c7-7b3a63d06142 successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb for user c0f1b4fcbee04ce0845f2f8fb3f14afe is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Marking volume 52cad9d7-8e39-4f65-a8c7-7b3a63d06142 as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Copying metadata from image 71120f13-1140-4938-836f-6085e103efeb to 52cad9d7-8e39-4f65-a8c7-7b3a63d06142. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Creating volume glance metadata for volume 52cad9d7-8e39-4f65-a8c7-7b3a63d06142 backed by image 71120f13-1140-4938-836f-6085e103efeb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7efee-aaa9-464f-8216-22ac935e1c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028ef2c90>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ecc877-c9f8-43aa-8da6-c7bf2cae7d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:24 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Volume volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 (52cad9d7-8e39-4f65-a8c7-7b3a63d06142): created successfully
Nov 05 11:59:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ecc877-c9f8-43aa-8da6-c7bf2cae7d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Flow 'volume_create_manager' (1e9822a4-573e-4938-9982-bb947178fafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-27e7bda3-51de-4573-9b86-2cf80401a062 tempest-VolumesImageMetadata-945375967 None] Created volume successfully.
Nov 05 11:59:26 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd" returned: 0 in 13.759s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4, size 1024.00 MB, duration 13.76 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 11:59:26 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Converted 1024.00 MB image at 74.42 MB/s
Nov 05 11:59:26 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd is being set with open permissions: ugo+rw
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Acquiring lock "cinder-52cad9d7-8e39-4f65-a8c7-7b3a63d06142-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Lock "cinder-52cad9d7-8e39-4f65-a8c7-7b3a63d06142-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:26 devstack sudo[94758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd
Nov 05 11:59:26 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Acquiring lock "cinder-quobyte-52cad9d7-8e39-4f65-a8c7-7b3a63d06142" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Lock "cinder-quobyte-52cad9d7-8e39-4f65-a8c7-7b3a63d06142" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d17a730-f4d4-40cf-9144-df84fe5cdacb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:27 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142
Nov 05 11:59:27 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:27 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd" returned: 0 in 0.529s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-7049e652-61b9-40d2-b6dc-809623e942bd" released by "_copy_volume_from_snapshot" :: held 16.348s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e-7049e652-61b9-40d2-b6dc-809623e942bd" released by "_create_volume_from_snapshot" :: held 16.507s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.539s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823e769e-c5a5-4192-810f-317167ebdca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7049e652-61b9-40d2-b6dc-809623e942bd', 'volume_size': 1, 'snapshot_id': 'a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6d4c29-14fd-494e-88b1-8a2ef8906b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Volume volume-7049e652-61b9-40d2-b6dc-809623e942bd (7049e652-61b9-40d2-b6dc-809623e942bd): created successfully
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6d4c29-14fd-494e-88b1-8a2ef8906b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Flow 'volume_create_manager' (1ba17673-4ad4-4e5d-baad-c2c82a494b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ea446c68-4967-4e43-a6be-eeb8f738564f tempest-VolumesSnapshotTestJSON-1430513968 None] Created volume successfully.
Nov 05 11:59:27 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142" returned: 0 in 0.656s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:27 devstack sudo[94767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142
Nov 05 11:59:27 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:27 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-52cad9d7-8e39-4f65-a8c7-7b3a63d06142" returned: 0 in 0.358s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Lock "cinder-quobyte-52cad9d7-8e39-4f65-a8c7-7b3a63d06142" released by "delete_volume" :: held 1.116s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Created reservations ['285966c9-c17a-4b89-a7cd-b14370ddb2da', '22027d92-97b4-4454-a64b-bfecb1336473', 'c6cf4b5f-71f2-4a13-8046-73399c3cf77c', '8db95c93-f39d-408c-8233-59f5ceafc2fd'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:28 devstack sudo[94772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:59:28 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:28 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.587s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-7049e652-61b9-40d2-b6dc-809623e942bd-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Deleted volume successfully.
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-7049e652-61b9-40d2-b6dc-809623e942bd-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b21a3a87-ba0d-4074-8940-8716333c2636 tempest-VolumesImageMetadata-945375967 None] Lock "cinder-52cad9d7-8e39-4f65-a8c7-7b3a63d06142-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-7049e652-61b9-40d2-b6dc-809623e942bd" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-7049e652-61b9-40d2-b6dc-809623e942bd" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:29 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed4a45-43be-4c99-9c04-c557677a2dd2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:29 devstack sudo[94776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd
Nov 05 11:59:29 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:29 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd" returned: 0 in 0.751s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:29 devstack sudo[94781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd
Nov 05 11:59:29 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:30 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7049e652-61b9-40d2-b6dc-809623e942bd" returned: 0 in 0.792s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-7049e652-61b9-40d2-b6dc-809623e942bd" released by "delete_volume" :: held 1.631s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:30 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['7de46971-a21f-4b4b-8e50-0600cefdf277', 'ea50d082-9495-4b34-b34c-8caf452d1375', '0778acce-c72e-406f-bffd-88cbb2dbbe17', '10cc0e49-97b0-4b91-8da5-69dbb96ac8b0'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:59:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:31 devstack sudo[94784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:59:31 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:31 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.563s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:31 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Deleted volume successfully.
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-1b5c717f-20da-4219-b673-8971a52010f4" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76b0513e-a628-44c4-aeb7-543fc507fe39 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-7049e652-61b9-40d2-b6dc-809623e942bd-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-1b5c717f-20da-4219-b673-8971a52010f4" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" acquired by "_delete_snapshot" :: waited 0.108s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Deleting offline snapshot a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e of volume 1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] snapshot_file for this snap is: volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5af73e4-4d89-48f3-9b5d-9db8c23af0ee]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:32 devstack sudo[94787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e
Nov 05 11:59:32 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:32 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" returned: 0 in 0.813s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5c717f-20da-4219-b673-8971a52010f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 11:59:32 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cc0f93-294d-4ca1-b3b1-1e531f5e7db5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:32 devstack sudo[94816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4
Nov 05 11:59:32 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-cc4d32a8-8f9e-410d-b8ce-135c5ed74339 req-c6a6643d-30ae-48b7-ab57-09370b5300e4 tempest-ServerActionsTestOtherA-1509821086 None] Terminate volume connection completed successfully.
Nov 05 11:59:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-cc4d32a8-8f9e-410d-b8ce-135c5ed74339 req-c6a6643d-30ae-48b7-ab57-09370b5300e4 tempest-ServerActionsTestOtherA-1509821086 None] Deleting attachment 1353363b-8835-4b7d-a0e3-f9e34575b9e5. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:59:33 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4" returned: 0 in 0.806s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:33 devstack sudo[94828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e
Nov 05 11:59:33 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:34 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" returned: 0 in 0.701s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:34 devstack sudo[94852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e
Nov 05 11:59:34 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:34 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4.a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" returned: 0 in 0.449s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e" released by "_delete_snapshot" :: held 3.072s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-1b5c717f-20da-4219-b673-8971a52010f4" released by "delete_snapshot" :: held 3.193s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:34 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['5143ccc5-d796-4c76-87ae-0febbb5e6882', 'ccfa9cf6-7c1e-47ac-a552-514ccff5986b', 'df795f79-7b70-4175-9ec2-dc74e309ec26', 'd03f9289-258f-4aaa-a86f-f66f3a7f3be0'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:59:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Delete snapshot completed successfully.
Nov 05 11:59:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfff5e95-bf82-42c1-8ac4-49c85aeab56c tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-a83c0b4b-c19e-46dd-82e2-7533a8bd7f4e-delete_snapshot" released by "delete_snapshot" :: held 3.439s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-1b5c717f-20da-4219-b673-8971a52010f4-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-1b5c717f-20da-4219-b673-8971a52010f4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-1b5c717f-20da-4219-b673-8971a52010f4" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-1b5c717f-20da-4219-b673-8971a52010f4" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a0c81-b31e-4e1f-b495-b0fa701462a6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:36 devstack sudo[94860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4
Nov 05 11:59:36 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-cc4d32a8-8f9e-410d-b8ce-135c5ed74339 req-a4b5a3e0-93d9-434e-8880-e396603de9ee tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-cc4d32a8-8f9e-410d-b8ce-135c5ed74339 req-a4b5a3e0-93d9-434e-8880-e396603de9ee tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-cc4d32a8-8f9e-410d-b8ce-135c5ed74339 req-a4b5a3e0-93d9-434e-8880-e396603de9ee tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-cc4d32a8-8f9e-410d-b8ce-135c5ed74339 req-a4b5a3e0-93d9-434e-8880-e396603de9ee tempest-ServerActionsTestOtherA-1509821086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-fd67012c-28a7-4f64-a998-adff957cd561', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9b5900b-55cf-4344-833e-743152de6aac', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 11:59:36 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-cc4d32a8-8f9e-410d-b8ce-135c5ed74339 req-a4b5a3e0-93d9-434e-8880-e396603de9ee tempest-ServerActionsTestOtherA-1509821086 None] attachment_update completed successfully.
Nov 05 11:59:36 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4" returned: 0 in 0.714s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:37 devstack sudo[94885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4
Nov 05 11:59:37 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Flow 'volume_create_manager' (8e647037-222b-4c97-b2d6-7ab77b07ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0a711e-7e16-4f13-b548-2d3fba9b8a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0a711e-7e16-4f13-b548-2d3fba9b8a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1380217773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869e5dc5-830f-4507-8aab-6799337e3272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0a5c3c4ef044bba72d521f139c0462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:37Z,use_quota=True,user_id='b7dcf1a2a472449faea65ed3047c9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba50a0f-773b-435b-8faf-08f7f7784b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba50a0f-773b-435b-8faf-08f7f7784b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae636c-1ca9-465d-91e3-79ad478c54a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae636c-1ca9-465d-91e3-79ad478c54a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869e5dc5-830f-4507-8aab-6799337e3272', 'volume_name': 'volume-869e5dc5-830f-4507-8aab-6799337e3272', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648491c9-6729-4a6a-be3d-b08f3d585579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648491c9-6729-4a6a-be3d-b08f3d585579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a4c6dd-de5c-4e6b-996c-02a1f397fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Volume 869e5dc5-830f-4507-8aab-6799337e3272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869e5dc5-830f-4507-8aab-6799337e3272', 'volume_size': 1}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1380217773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869e5dc5-830f-4507-8aab-6799337e3272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0a5c3c4ef044bba72d521f139c0462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:37Z,use_quota=True,user_id='b7dcf1a2a472449faea65ed3047c9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Creating volume 869e5dc5-830f-4507-8aab-6799337e3272 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:37 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:59:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1b5c717f-20da-4219-b673-8971a52010f4" returned: 0 in 0.469s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:37 devstack sudo[94900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272 1073741824
Nov 05 11:59:37 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-1b5c717f-20da-4219-b673-8971a52010f4" released by "delete_volume" :: held 1.347s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['425b6b13-7c67-4756-8218-a150ce6e5036', '5846bb64-b256-4f4b-953f-d6a57a2ba4a6', '83604948-d384-4d46-abe6-11a7333edf1f', 'ffb10234-ce36-40e8-86b1-879dfdef31fc'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:37 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:59:37 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:38 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.425s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Deleted volume successfully.
Nov 05 11:59:38 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272 1073741824" returned: 0 in 0.957s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-203838e4-9690-4e9e-9fc0-448fcd2254cd tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-1b5c717f-20da-4219-b673-8971a52010f4-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:38 devstack sudo[94936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272
Nov 05 11:59:38 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-629457ea-c11f-473c-8f0e-e9ff82e9f7d8-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-629457ea-c11f-473c-8f0e-e9ff82e9f7d8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "cinder-quobyte-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" acquired by "delete_volume" :: waited 0.040s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[325d9021-032a-49f2-8ee7-88b5b1f6b188]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:39 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272" returned: 0 in 0.643s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a4c6dd-de5c-4e6b-996c-02a1f397fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869e5dc5-830f-4507-8aab-6799337e3272', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:39 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8
Nov 05 11:59:39 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a144b2c0-7044-42a2-8857-0d84dd44162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:39 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Volume volume-869e5dc5-830f-4507-8aab-6799337e3272 (869e5dc5-830f-4507-8aab-6799337e3272): created successfully
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a144b2c0-7044-42a2-8857-0d84dd44162f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Flow 'volume_create_manager' (8e647037-222b-4c97-b2d6-7ab77b07ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a4b5c94d-6ef9-40a9-b988-a204df965e04 tempest-VolumesMetadataTest-277162912 None] Created volume successfully.
Nov 05 11:59:39 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" returned: 0 in 0.612s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:39 devstack sudo[94949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8
Nov 05 11:59:39 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:39 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" returned: 0 in 0.416s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-quobyte-629457ea-c11f-473c-8f0e-e9ff82e9f7d8" released by "delete_volume" :: held 1.165s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Created reservations ['3239c9f6-dee5-48f2-bd8e-f37905043393', 'c8d5d277-abf4-4fd9-ab91-806cddaea73d', 'a02f4af5-b0d6-4fbf-a093-b917def5611a', '848e3059-1d24-48dc-9bfe-895723c548d5'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:40 devstack sudo[94952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:59:40 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:40 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.524s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Deleted volume successfully.
Nov 05 11:59:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-144f3055-7820-4648-81e5-d01b32e8dbf2 tempest-VolumesSnapshotTestJSON-1430513968 None] Lock "cinder-629457ea-c11f-473c-8f0e-e9ff82e9f7d8-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-249dbddd-f5bb-46e9-b146-5e240d49602d req-f3bea72e-4624-459c-bafb-8f0715e1646c tempest-AttachVolumeNegativeTest-1143206013 None] Terminate volume connection completed successfully.
Nov 05 11:59:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-249dbddd-f5bb-46e9-b146-5e240d49602d req-f3bea72e-4624-459c-bafb-8f0715e1646c tempest-AttachVolumeNegativeTest-1143206013 None] Deleting attachment c813c561-015a-4d00-bd11-384f06794015. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 11:59:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Acquiring lock "cinder-869e5dc5-830f-4507-8aab-6799337e3272-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Lock "cinder-869e5dc5-830f-4507-8aab-6799337e3272-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Acquiring lock "cinder-quobyte-869e5dc5-830f-4507-8aab-6799337e3272" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Lock "cinder-quobyte-869e5dc5-830f-4507-8aab-6799337e3272" acquired by "delete_volume" :: waited 0.041s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:42 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb84a8-bb6e-4131-8b27-3c1b389862b4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:42 devstack sudo[94961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272
Nov 05 11:59:42 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:43 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272" returned: 0 in 1.040s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:43 devstack sudo[94987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272
Nov 05 11:59:43 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:43 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-869e5dc5-830f-4507-8aab-6799337e3272" returned: 0 in 0.467s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Lock "cinder-quobyte-869e5dc5-830f-4507-8aab-6799337e3272" released by "delete_volume" :: held 1.593s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Created reservations ['88d0ea64-4a49-4703-a788-c9d5d5d28174', '08500888-3396-494a-bd0e-b90667df1d0d', '1318ddd8-48c4-4fbc-bceb-b46751b0bdbb', '1d0c03cc-c476-4a6b-9d06-c8eb0fb2614f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:44 devstack sudo[94992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 11:59:44 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:44 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.501s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:44 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 11:59:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Deleted volume successfully.
Nov 05 11:59:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1125a13c-1c35-4091-80bd-016746725b45 tempest-VolumesMetadataTest-277162912 None] Lock "cinder-869e5dc5-830f-4507-8aab-6799337e3272-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Flow 'volume_create_manager' (8b8d1937-3a5a-4391-806e-a0b5c9eb0c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3372259e-5486-49b7-a83b-0dcd8a3bfb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3372259e-5486-49b7-a83b-0dcd8a3bfb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1725768007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4726bf20-f7d9-424c-9eb9-0484caee5d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07aa3562c644b3eb4744f81a48f1ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:54Z,use_quota=True,user_id='929f750b7c874d8eac2bebbc0c89376a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a29368e-b965-48d2-b3f1-ac3adeeba6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a29368e-b965-48d2-b3f1-ac3adeeba6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eecaec4-f68a-489d-8224-02776c763fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eecaec4-f68a-489d-8224-02776c763fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4726bf20-f7d9-424c-9eb9-0484caee5d72', 'volume_name': 'volume-4726bf20-f7d9-424c-9eb9-0484caee5d72', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e939b2-dd0e-4ceb-9c66-036cc772b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e939b2-dd0e-4ceb-9c66-036cc772b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebdb276-3c34-4b4d-919b-12ea6545c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Volume 4726bf20-f7d9-424c-9eb9-0484caee5d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4726bf20-f7d9-424c-9eb9-0484caee5d72', 'volume_size': 1}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T10:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1725768007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4726bf20-f7d9-424c-9eb9-0484caee5d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07aa3562c644b3eb4744f81a48f1ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:59:54Z,use_quota=True,user_id='929f750b7c874d8eac2bebbc0c89376a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Creating volume 4726bf20-f7d9-424c-9eb9-0484caee5d72 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 11:59:54 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 11:59:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:54 devstack sudo[95011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72 1073741824
Nov 05 11:59:54 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:55 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72 1073741824" returned: 0 in 0.720s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:55 devstack sudo[95017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72
Nov 05 11:59:55 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:55 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72" returned: 0 in 0.433s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebdb276-3c34-4b4d-919b-12ea6545c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4726bf20-f7d9-424c-9eb9-0484caee5d72', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d167028-892e-47ac-9f64-4b1b83317d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 11:59:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Volume volume-4726bf20-f7d9-424c-9eb9-0484caee5d72 (4726bf20-f7d9-424c-9eb9-0484caee5d72): created successfully
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d167028-892e-47ac-9f64-4b1b83317d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 11:59:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Flow 'volume_create_manager' (8b8d1937-3a5a-4391-806e-a0b5c9eb0c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 11:59:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d53ddd57-fea3-4711-aad1-ce670e7f3ab2 tempest-VolumesTransfersV355Test-46060677 None] Created volume successfully.
Nov 05 11:59:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e6a3c19b-c4bd-4fbf-904b-42bea1f4f4b6 tempest-VolumesTransfersV355Test-1994901763 None] Transfer volume completed successfully.
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Acquiring lock "cinder-4726bf20-f7d9-424c-9eb9-0484caee5d72-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-4726bf20-f7d9-424c-9eb9-0484caee5d72-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Acquiring lock "cinder-quobyte-4726bf20-f7d9-424c-9eb9-0484caee5d72" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-quobyte-4726bf20-f7d9-424c-9eb9-0484caee5d72" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1509b37-356d-4ccc-9273-6e273838d544]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:59 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72
Nov 05 11:59:59 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 11:59:59 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72" returned: 0 in 0.563s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 11:59:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 11:59:59 devstack sudo[95070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72
Nov 05 11:59:59 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:00 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4726bf20-f7d9-424c-9eb9-0484caee5d72" returned: 0 in 0.428s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-quobyte-4726bf20-f7d9-424c-9eb9-0484caee5d72" released by "delete_volume" :: held 1.065s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Created reservations ['9418a05f-9864-459d-9138-91ac31f2a87e', 'c5da8d62-5fee-460e-b516-18814a30291a', 'bec2958e-93f1-460f-9478-326da93278a4', 'f3f15086-f987-4045-9b75-c878ff7bb940'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:00 devstack sudo[95074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:00:00 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:01 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.664s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:01 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Deleted volume successfully.
Nov 05 12:00:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3cd5e596-adcc-4d40-b179-e82abcffff7f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-4726bf20-f7d9-424c-9eb9-0484caee5d72-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Flow 'volume_create_manager' (faf10c36-733b-4745-979c-a2d63adc13c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268769bf-c138-41c3-94b8-58ee5d80fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268769bf-c138-41c3-94b8-58ee5d80fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2012280993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7521ffd-b775-4b57-a18c-1bf4665aabe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07aa3562c644b3eb4744f81a48f1ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:03Z,use_quota=True,user_id='929f750b7c874d8eac2bebbc0c89376a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e9207e-a6d6-46ab-831b-b1c84c0ca9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e9207e-a6d6-46ab-831b-b1c84c0ca9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f750f7f-0e96-4f5d-9a8d-264b55c1dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f750f7f-0e96-4f5d-9a8d-264b55c1dae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7521ffd-b775-4b57-a18c-1bf4665aabe1', 'volume_name': 'volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd26f0e6-91ce-4c37-8e9f-0335198f99c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd26f0e6-91ce-4c37-8e9f-0335198f99c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b1112a-490a-40fe-992a-c48b8af3242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Volume d7521ffd-b775-4b57-a18c-1bf4665aabe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1', 'volume_size': 1}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2012280993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7521ffd-b775-4b57-a18c-1bf4665aabe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07aa3562c644b3eb4744f81a48f1ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:03Z,use_quota=True,user_id='929f750b7c874d8eac2bebbc0c89376a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Creating volume d7521ffd-b775-4b57-a18c-1bf4665aabe1 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:03 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:00:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:03 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1 1073741824
Nov 05 12:00:03 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:04 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1 1073741824" returned: 0 in 1.194s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:04 devstack sudo[95193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1
Nov 05 12:00:04 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:05 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1" returned: 0 in 0.625s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b1112a-490a-40fe-992a-c48b8af3242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454843f8-dc0b-4532-8d0e-48f592dc55cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:05 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Volume volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1 (d7521ffd-b775-4b57-a18c-1bf4665aabe1): created successfully
Nov 05 12:00:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454843f8-dc0b-4532-8d0e-48f592dc55cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Flow 'volume_create_manager' (faf10c36-733b-4745-979c-a2d63adc13c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bedd3fdc-5b39-4fdf-8ecb-b2408206aa21 tempest-VolumesTransfersV355Test-46060677 None] Created volume successfully.
Nov 05 12:00:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Acquiring lock "cinder-d7521ffd-b775-4b57-a18c-1bf4665aabe1-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-d7521ffd-b775-4b57-a18c-1bf4665aabe1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Acquiring lock "cinder-quobyte-d7521ffd-b775-4b57-a18c-1bf4665aabe1" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-quobyte-d7521ffd-b775-4b57-a18c-1bf4665aabe1" acquired by "delete_volume" :: waited 0.049s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[db72f610-d645-48e1-8ff6-ff4ea8f43450]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:07 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1
Nov 05 12:00:07 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:08 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1" returned: 0 in 0.644s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:08 devstack sudo[95204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1
Nov 05 12:00:08 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:08 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d7521ffd-b775-4b57-a18c-1bf4665aabe1" returned: 0 in 0.426s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-quobyte-d7521ffd-b775-4b57-a18c-1bf4665aabe1" released by "delete_volume" :: held 1.156s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Created reservations ['581cd518-423b-456f-ad93-c4552cdc49a9', 'f3a56259-a484-4590-9075-01a1e0edb222', '78825c2f-1c8b-461a-b97a-6de04a857023', 'c9a51102-6d5a-4d1e-a2d6-d44b68f52e57'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:08 devstack sudo[95207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:00:08 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:09 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.445s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:09 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:09 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Deleted volume successfully.
Nov 05 12:00:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5a0d59e9-de53-41c4-b115-19f3ec6e0d2f tempest-VolumesTransfersV355Test-948555274 None] Lock "cinder-d7521ffd-b775-4b57-a18c-1bf4665aabe1-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:00:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:13 devstack sudo[95213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:00:13 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:14 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.640s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:00:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:00:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:00:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-3af36652-23c0-4a4f-9202-eb5cc4617cba tempest-ServerActionsTestOtherA-1509821086 None] Terminate volume connection completed successfully.
Nov 05 12:00:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-3af36652-23c0-4a4f-9202-eb5cc4617cba tempest-ServerActionsTestOtherA-1509821086 None] Deleting attachment d9b5900b-55cf-4344-833e-743152de6aac. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:00:18 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=75,cinder:INSERT=25,cinder:UPDATE=71,cinder:DELETE=6 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "cinder-fd67012c-28a7-4f64-a998-adff957cd561-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-fd67012c-28a7-4f64-a998-adff957cd561-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "cinder-quobyte-fd67012c-28a7-4f64-a998-adff957cd561" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-quobyte-fd67012c-28a7-4f64-a998-adff957cd561" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77372a0-dd92-45f0-ae84-1450026ba1de]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:19 devstack sudo[95275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561
Nov 05 12:00:19 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:19 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561" returned: 0 in 0.580s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:19 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561
Nov 05 12:00:19 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:20 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fd67012c-28a7-4f64-a998-adff957cd561" returned: 0 in 0.296s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-quobyte-fd67012c-28a7-4f64-a998-adff957cd561" released by "delete_volume" :: held 0.954s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.quota [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Created reservations ['c24a0bc0-36f0-46da-8614-0d58fb24225a', '29afe442-9a28-4dcc-b96a-6c9fe0fcf141', '2e8619f1-2a6f-44bd-bfeb-2fe96ef5249d', '704d2bc3-a5b0-4d8f-99a0-266a589e9b8c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "cinder-6d7e0517-b5d8-422d-9360-44205ec38a36-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-6d7e0517-b5d8-422d-9360-44205ec38a36-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "cinder-quobyte-6d7e0517-b5d8-422d-9360-44205ec38a36" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:20 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:00:20 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-quobyte-6d7e0517-b5d8-422d-9360-44205ec38a36" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[983710ab-4847-4e23-8b92-6b7267c4fb62]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:20 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36
Nov 05 12:00:20 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:20 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.367s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.manager [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:20 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Deleted volume successfully.
Nov 05 12:00:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-5632e83c-e569-4ebb-b161-22e40a007fe1 req-41acab40-c92b-4e9e-a2b3-14c73266664c tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-fd67012c-28a7-4f64-a998-adff957cd561-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:21 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36" returned: 0 in 0.581s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:21 devstack sudo[95293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36
Nov 05 12:00:21 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:21 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6d7e0517-b5d8-422d-9360-44205ec38a36" returned: 0 in 0.308s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-quobyte-6d7e0517-b5d8-422d-9360-44205ec38a36" released by "delete_volume" :: held 0.978s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=90,cinder:INSERT=24,cinder:SELECT=61,cinder:DELETE=6 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Created reservations ['fd46caad-faa2-46db-825f-85b690b8098b', '79599df9-f6d9-4b3c-a675-f4215fb290f5', '0f6f9c53-ba26-48f5-83f0-5046d928a5d2', 'ff3416dd-b443-49de-8289-0aa3ae6f404c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:21 devstack sudo[95296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:00:21 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:21 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.303s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Deleted volume successfully.
Nov 05 12:00:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-dea4d440-8c52-4fe5-bac2-9c5f62daa92d tempest-ServerActionsTestOtherA-1509821086 None] Lock "cinder-6d7e0517-b5d8-422d-9360-44205ec38a36-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Flow 'volume_create_manager' (9be1b251-e511-431a-aa04-9ae33cd61dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b547b8-65c8-434f-a43b-16f7957b8041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b547b8-65c8-434f-a43b-16f7957b8041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-567653455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a140367-b828-469d-a8d1-fd58e064f649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6701462e6f0b4d66aa44a0c253e291da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:24Z,use_quota=True,user_id='ac09a6b5b50c4ac4b685138bb5face93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81096d9c-8612-43fe-b15b-a51b4420cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81096d9c-8612-43fe-b15b-a51b4420cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8236de-f823-40a9-bd75-82fc7614431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8236de-f823-40a9-bd75-82fc7614431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a140367-b828-469d-a8d1-fd58e064f649', 'volume_name': 'volume-7a140367-b828-469d-a8d1-fd58e064f649', 'volume_size': 2}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd1df90-81b7-4857-979c-17cf20517983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd1df90-81b7-4857-979c-17cf20517983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46baa570-0601-434b-878f-eb5e3a289eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:23 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Volume 7a140367-b828-469d-a8d1-fd58e064f649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a140367-b828-469d-a8d1-fd58e064f649', 'volume_size': 2}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-567653455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a140367-b828-469d-a8d1-fd58e064f649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6701462e6f0b4d66aa44a0c253e291da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:24Z,use_quota=True,user_id='ac09a6b5b50c4ac4b685138bb5face93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Creating volume 7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:23 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:00:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 2147483648 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:23 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 2147483648
Nov 05 12:00:23 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:24 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 2147483648" returned: 0 in 0.825s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:24 devstack sudo[95332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649
Nov 05 12:00:24 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:25 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649" returned: 0 in 0.344s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46baa570-0601-434b-878f-eb5e3a289eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a140367-b828-469d-a8d1-fd58e064f649', 'volume_size': 2}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6836fcb2-1758-4325-99a2-2765dedc2472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:25 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Volume volume-7a140367-b828-469d-a8d1-fd58e064f649 (7a140367-b828-469d-a8d1-fd58e064f649): created successfully
Nov 05 12:00:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6836fcb2-1758-4325-99a2-2765dedc2472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Flow 'volume_create_manager' (9be1b251-e511-431a-aa04-9ae33cd61dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a41a9a1e-2ae0-48ed-b47f-822e6dd6cca4 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Created volume successfully.
Nov 05 12:00:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Creating offline snapshot 6244032f-6922-4a02-96de-63c504404fbe of volume 7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:00:26 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[572cae19-00c3-4f3f-8192-d5b19c0e50ca]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:26 devstack sudo[95335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649
Nov 05 12:00:26 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:26 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649" returned: 0 in 0.591s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe 2G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:26 devstack sudo[95341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe 2G
Nov 05 12:00:26 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:27 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe 2G" returned: 0 in 0.779s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a140367-b828-469d-a8d1-fd58e064f649 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:27 devstack sudo[95348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a140367-b828-469d-a8d1-fd58e064f649 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe
Nov 05 12:00:27 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:28 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a140367-b828-469d-a8d1-fd58e064f649 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe" returned: 0 in 0.416s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:28 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe is being set with open permissions: ugo+rw
Nov 05 12:00:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:28 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe
Nov 05 12:00:28 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:28 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe" returned: 0 in 0.500s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:28 devstack sudo[95357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.info
Nov 05 12:00:28 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:28 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.info" returned: 0 in 0.350s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:28 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.info is being set with open permissions: ugo+rw
Nov 05 12:00:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:28 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.info
Nov 05 12:00:28 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:29 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.info" returned: 0 in 0.521s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.370s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:29 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5c4e7782-71c6-4b87-a949-471fa834274a tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Create snapshot completed successfully
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Flow 'volume_create_manager' (1768d277-411f-4197-abc2-c9f4c416458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122f4569-6fae-4e4c-a880-0cf7c88056d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122f4569-6fae-4e4c-a880-0cf7c88056d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1616300686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50241b49-c78a-4a29-8328-d5b1aae7f4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea507c70a15446cb980c504c59da073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:30Z,use_quota=True,user_id='89436e30ae544a24b3779a942061b23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b06666-7d55-4566-b447-2ca4d7794f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b06666-7d55-4566-b447-2ca4d7794f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ab5f21-f01e-4db5-b047-5e13d2b12eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ab5f21-f01e-4db5-b047-5e13d2b12eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50241b49-c78a-4a29-8328-d5b1aae7f4dc', 'volume_name': 'volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff941b8-7d96-4e24-a019-5e26fcd11c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff941b8-7d96-4e24-a019-5e26fcd11c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10915cc3-570e-45a3-9b1c-b06b767c7157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Volume 50241b49-c78a-4a29-8328-d5b1aae7f4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc', 'volume_size': 1}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1616300686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50241b49-c78a-4a29-8328-d5b1aae7f4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea507c70a15446cb980c504c59da073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:30Z,use_quota=True,user_id='89436e30ae544a24b3779a942061b23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Creating volume 50241b49-c78a-4a29-8328-d5b1aae7f4dc {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:30 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "cinder-6244032f-6922-4a02-96de-63c504404fbe-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:30 devstack sudo[95365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc 1073741824
Nov 05 12:00:30 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-6244032f-6922-4a02-96de-63c504404fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "cinder-quobyte-7a140367-b828-469d-a8d1-fd58e064f649" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-quobyte-7a140367-b828-469d-a8d1-fd58e064f649" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "cinder-quobyte-6244032f-6922-4a02-96de-63c504404fbe" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-quobyte-6244032f-6922-4a02-96de-63c504404fbe" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Deleting offline snapshot 6244032f-6922-4a02-96de-63c504404fbe of volume 7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] snapshot_file for this snap is: volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018a51e-8e03-4c81-9648-30fc72265476]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:31 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe
Nov 05 12:00:31 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:31 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc 1073741824" returned: 0 in 0.752s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:31 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe" returned: 0 in 0.556s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a140367-b828-469d-a8d1-fd58e064f649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bb07e0-5303-455a-8a25-4c1aaa583a9b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:31 devstack sudo[95376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc
Nov 05 12:00:31 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:31 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649
Nov 05 12:00:31 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:31 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc" returned: 0 in 0.459s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10915cc3-570e-45a3-9b1c-b06b767c7157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561c6430-f1a4-4474-9455-d90bc6605024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:32 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Volume volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc (50241b49-c78a-4a29-8328-d5b1aae7f4dc): created successfully
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561c6430-f1a4-4474-9455-d90bc6605024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Flow 'volume_create_manager' (1768d277-411f-4197-abc2-c9f4c416458d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-26764d30-bbe3-4998-b261-1c8974bd1b31 tempest-AttachVolumeNegativeTest-1143206013 None] Created volume successfully.
Nov 05 12:00:32 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649" returned: 0 in 0.715s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:32 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe
Nov 05 12:00:32 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Flow 'volume_create_manager' (9cb58b7b-9223-429c-ad3f-88a48f3d63f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b27d862-9447-4ea3-abdf-dd74680f646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b27d862-9447-4ea3-abdf-dd74680f646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-635336196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3457ade6-b004-423e-87a9-52f3d2cc20aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d14f45963d45c9b51a061a723b1fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:32Z,use_quota=True,user_id='8cd4edb56893445a9c536b38329deacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc5f54c-4e3b-43d0-b0ff-a0959c628f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc5f54c-4e3b-43d0-b0ff-a0959c628f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77961905-2c84-462f-bd5f-f5c0d6f0f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77961905-2c84-462f-bd5f-f5c0d6f0f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3457ade6-b004-423e-87a9-52f3d2cc20aa', 'volume_name': 'volume-3457ade6-b004-423e-87a9-52f3d2cc20aa', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8f470b-de93-446b-84d3-5e8cfeeb34e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8f470b-de93-446b-84d3-5e8cfeeb34e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbc0583-3557-4431-b634-7e03d1e66386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:32 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Volume 3457ade6-b004-423e-87a9-52f3d2cc20aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3457ade6-b004-423e-87a9-52f3d2cc20aa', 'volume_size': 1}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-635336196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3457ade6-b004-423e-87a9-52f3d2cc20aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d14f45963d45c9b51a061a723b1fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:32Z,use_quota=True,user_id='8cd4edb56893445a9c536b38329deacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Creating volume 3457ade6-b004-423e-87a9-52f3d2cc20aa {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:32 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:00:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:32 devstack sudo[95387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa 1073741824
Nov 05 12:00:32 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:33 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Flow 'volume_create_manager' (d316919e-ef90-410b-97d2-f981b3af54ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b032204e-5589-4525-a95a-d0c128f0c426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe" returned: 0 in 0.954s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b032204e-5589-4525-a95a-d0c128f0c426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2114808138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0fe292-1d68-4a94-b096-07097b0c9427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d14f45963d45c9b51a061a723b1fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:33Z,use_quota=True,user_id='8cd4edb56893445a9c536b38329deacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba192af-55c7-453b-90b3-a2e1e65adf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:33 devstack sudo[95396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba192af-55c7-453b-90b3-a2e1e65adf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:33 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad632bb-7ac1-41e6-a938-a7073665e2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad632bb-7ac1-41e6-a938-a7073665e2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0fe292-1d68-4a94-b096-07097b0c9427', 'volume_name': 'volume-ef0fe292-1d68-4a94-b096-07097b0c9427', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259de37d-56c1-41e2-8a01-df7d71d7b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259de37d-56c1-41e2-8a01-df7d71d7b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31da98d-419f-4fe4-9df1-12798d2829e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:33 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Volume ef0fe292-1d68-4a94-b096-07097b0c9427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0fe292-1d68-4a94-b096-07097b0c9427', 'volume_size': 1}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:33 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa 1073741824" returned: 0 in 1.317s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:33 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649.6244032f-6922-4a02-96de-63c504404fbe" returned: 0 in 0.696s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:33 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa
Nov 05 12:00:33 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-quobyte-6244032f-6922-4a02-96de-63c504404fbe" released by "_delete_snapshot" :: held 3.195s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-quobyte-7a140367-b828-469d-a8d1-fd58e064f649" released by "delete_snapshot" :: held 3.239s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Created reservations ['0e8ba7fb-833e-4a3f-b88e-0187e6ba224c', '823d5ea0-940c-414f-ab73-ac77e094fa89', 'b2d2d83c-695c-4d21-9219-6fb9829958f0', '1b9e140e-702e-4901-bcec-222806f90981'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Delete snapshot completed successfully.
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-417229b0-3670-4649-8efb-7fca7e619ac7 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-6244032f-6922-4a02-96de-63c504404fbe-delete_snapshot" released by "delete_snapshot" :: held 3.512s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:34 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa" returned: 0 in 0.383s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2114808138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0fe292-1d68-4a94-b096-07097b0c9427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d14f45963d45c9b51a061a723b1fcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:00:33Z,use_quota=True,user_id='8cd4edb56893445a9c536b38329deacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Creating volume ef0fe292-1d68-4a94-b096-07097b0c9427 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:00:34 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:34 devstack sudo[95416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427 1073741824
Nov 05 12:00:34 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbc0583-3557-4431-b634-7e03d1e66386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3457ade6-b004-423e-87a9-52f3d2cc20aa', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4998a2-0022-48dd-b509-eb9d77d1f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-7ec42285-bc67-4c4f-937e-79bd55c43248 req-ba696ead-3ec7-4b9c-a769-fc2b477c50e0 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Volume volume-3457ade6-b004-423e-87a9-52f3d2cc20aa (3457ade6-b004-423e-87a9-52f3d2cc20aa): created successfully
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4998a2-0022-48dd-b509-eb9d77d1f94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Flow 'volume_create_manager' (9cb58b7b-9223-429c-ad3f-88a48f3d63f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-37d6387d-073c-4259-95fc-eab23f5fec2b tempest-TestServerVolumeAttachmentScenario-1797614666 None] Created volume successfully.
Nov 05 12:00:34 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427 1073741824" returned: 0 in 0.686s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:35 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427
Nov 05 12:00:35 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "cinder-7a140367-b828-469d-a8d1-fd58e064f649-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-7a140367-b828-469d-a8d1-fd58e064f649-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "cinder-quobyte-7a140367-b828-469d-a8d1-fd58e064f649" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-quobyte-7a140367-b828-469d-a8d1-fd58e064f649" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ca434-3f18-4e8e-9036-854d56114103]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:35 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427" returned: 0 in 0.433s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-7ec42285-bc67-4c4f-937e-79bd55c43248 req-ba696ead-3ec7-4b9c-a769-fc2b477c50e0 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.137s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31da98d-419f-4fe4-9df1-12798d2829e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0fe292-1d68-4a94-b096-07097b0c9427', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78523227-babd-44ac-bad3-9621ae16abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:00:35 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649
Nov 05 12:00:35 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-7ec42285-bc67-4c4f-937e-79bd55c43248 req-ba696ead-3ec7-4b9c-a769-fc2b477c50e0 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:35 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Volume volume-ef0fe292-1d68-4a94-b096-07097b0c9427 (ef0fe292-1d68-4a94-b096-07097b0c9427): created successfully
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78523227-babd-44ac-bad3-9621ae16abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Flow 'volume_create_manager' (d316919e-ef90-410b-97d2-f981b3af54ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:00:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f59e40a5-3781-4f11-889e-811765e077f3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Created volume successfully.
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-7ec42285-bc67-4c4f-937e-79bd55c43248 req-ba696ead-3ec7-4b9c-a769-fc2b477c50e0 tempest-AttachVolumeNegativeTest-1143206013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29e2750b-0419-46ea-97c9-502fd5bbcbc9', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:00:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-7ec42285-bc67-4c4f-937e-79bd55c43248 req-ba696ead-3ec7-4b9c-a769-fc2b477c50e0 tempest-AttachVolumeNegativeTest-1143206013 None] attachment_update completed successfully.
Nov 05 12:00:35 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649" returned: 0 in 0.606s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:36 devstack sudo[95526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649
Nov 05 12:00:36 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:36 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7a140367-b828-469d-a8d1-fd58e064f649" returned: 0 in 0.474s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-quobyte-7a140367-b828-469d-a8d1-fd58e064f649" released by "delete_volume" :: held 1.240s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Created reservations ['4caacbad-d0f9-44f1-9239-63db84dae357', 'f56d8adb-c68b-4892-9bd6-a666c21b8135', '3e9b5bc2-695a-4183-a51b-f6086cfe2798', 'e38ce972-7828-446e-8da5-2c040a024614'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:00:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:00:36 devstack sudo[95850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:00:36 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:00:37 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root
Nov 05 12:00:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.435s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:00:37 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:00:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Deleted volume successfully.
Nov 05 12:00:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-facd8f9e-c9f9-4afb-b80b-caae33e56ad1 tempest-VolumesSnapshotNegativeTestJSON-319469198 None] Lock "cinder-7a140367-b828-469d-a8d1-fd58e064f649-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:00:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-edb14ccd-9773-49e3-8930-7bf4a72489a8 req-9933b066-a6d0-4e1f-8a8b-9985df30f59c tempest-AttachVolumeNegativeTest-1143206013 None] Terminate volume connection completed successfully.
Nov 05 12:00:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-edb14ccd-9773-49e3-8930-7bf4a72489a8 req-9933b066-a6d0-4e1f-8a8b-9985df30f59c tempest-AttachVolumeNegativeTest-1143206013 None] Deleting attachment 29e2750b-0419-46ea-97c9-502fd5bbcbc9. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:00:48 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=40,cinder:SELECT=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:00:48 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=40,cinder:UPDATE=42,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:01:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:01:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:13 devstack sudo[96070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:01:13 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:14 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.409s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:01:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:01:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Flow 'volume_create_manager' (67faa7cc-8b68-4ed6-b456-f8976eb97ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da6dec8-e9de-46f5-b312-b643cb99720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da6dec8-e9de-46f5-b312-b643cb99720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-513074785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211fba56-f557-4df4-9a19-31511dbe701e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8bd1c86a714b089e46799fe2f17bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:27Z,use_quota=True,user_id='242fb27bb36c4785897e2cc6deed0b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f1807ed-cc8c-4244-bf9c-046f54668280),volume_type_id=8f1807ed-cc8c-4244-bf9c-046f54668280)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0133bfe2-fc39-401c-bda0-e8c9dd912918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0133bfe2-fc39-401c-bda0-e8c9dd912918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0293e6-b55e-4ce3-b6f4-ef7a2b4b3fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0293e6-b55e-4ce3-b6f4-ef7a2b4b3fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211fba56-f557-4df4-9a19-31511dbe701e', 'volume_name': 'volume-211fba56-f557-4df4-9a19-31511dbe701e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e9325e-98c5-4a86-a923-815959336ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e9325e-98c5-4a86-a923-815959336ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3cd072-9abc-4670-9cc7-dcc9ae10256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Volume 211fba56-f557-4df4-9a19-31511dbe701e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211fba56-f557-4df4-9a19-31511dbe701e', 'volume_size': 1}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-513074785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211fba56-f557-4df4-9a19-31511dbe701e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8bd1c86a714b089e46799fe2f17bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:27Z,use_quota=True,user_id='242fb27bb36c4785897e2cc6deed0b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f1807ed-cc8c-4244-bf9c-046f54668280),volume_type_id=8f1807ed-cc8c-4244-bf9c-046f54668280)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Creating volume 211fba56-f557-4df4-9a19-31511dbe701e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:27 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:01:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:27 devstack sudo[96254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e 1073741824
Nov 05 12:01:27 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Flow 'volume_create_manager' (6a335198-bc00-46d3-9e30-bdb915b4c22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28a26b6-52af-4c29-895c-bda5b592d9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28a26b6-52af-4c29-895c-bda5b592d9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-715488843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c815ee-26da-4cdc-bc68-edd20cfe15e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8bd1c86a714b089e46799fe2f17bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:29Z,use_quota=True,user_id='242fb27bb36c4785897e2cc6deed0b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3cbcabf-80e6-40e5-812c-0d1c40fa1eda),volume_type_id=c3cbcabf-80e6-40e5-812c-0d1c40fa1eda)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5d08af-5e1b-4f39-842a-11d944d41a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5d08af-5e1b-4f39-842a-11d944d41a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079cf04-f082-43dc-90be-086903b625f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079cf04-f082-43dc-90be-086903b625f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c815ee-26da-4cdc-bc68-edd20cfe15e6', 'volume_name': 'volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c861ba58-b042-40d5-8a2c-15e83f18a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c861ba58-b042-40d5-8a2c-15e83f18a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc9b03b-95cf-4dd1-96ad-96b09ffdbfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:28 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Volume 75c815ee-26da-4cdc-bc68-edd20cfe15e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6', 'volume_size': 1}
Nov 05 12:01:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:29 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e 1073741824" returned: 0 in 1.851s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:29 devstack sudo[96267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e
Nov 05 12:01:29 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:30 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e" returned: 0 in 0.640s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.669s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-715488843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c815ee-26da-4cdc-bc68-edd20cfe15e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8bd1c86a714b089e46799fe2f17bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:29Z,use_quota=True,user_id='242fb27bb36c4785897e2cc6deed0b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3cbcabf-80e6-40e5-812c-0d1c40fa1eda),volume_type_id=c3cbcabf-80e6-40e5-812c-0d1c40fa1eda)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Creating volume 75c815ee-26da-4cdc-bc68-edd20cfe15e6 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:30 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:30 devstack sudo[96273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6 1073741824
Nov 05 12:01:30 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3cd072-9abc-4670-9cc7-dcc9ae10256c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211fba56-f557-4df4-9a19-31511dbe701e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859f60d5-cc42-45e4-8540-fc7ef43b07a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Volume volume-211fba56-f557-4df4-9a19-31511dbe701e (211fba56-f557-4df4-9a19-31511dbe701e): created successfully
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859f60d5-cc42-45e4-8540-fc7ef43b07a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Flow 'volume_create_manager' (67faa7cc-8b68-4ed6-b456-f8976eb97ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-76cf5c68-3b97-442e-8926-8592f7f3f255 tempest-TestInstancesWithCinderVolumes-625618561 None] Created volume successfully.
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Flow 'volume_create_manager' (d6b2d07b-25a3-4419-bb8c-74c894b82f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4619b7-2071-4af1-8649-6c7df26f0588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4619b7-2071-4af1-8649-6c7df26f0588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-593856000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8bd1c86a714b089e46799fe2f17bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:31Z,use_quota=True,user_id='242fb27bb36c4785897e2cc6deed0b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c197637d-ac45-4242-ba87-8e1a32299d9b),volume_type_id=c197637d-ac45-4242-ba87-8e1a32299d9b)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6c18d5-8b01-4a91-833f-2b8685b8aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6c18d5-8b01-4a91-833f-2b8685b8aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f565f8-ca7a-4f0f-b3a0-5277675bde65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:30 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:01:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-213824f4-445c-4bb7-8d65-29c26bc9e304 req-ec727c17-3773-4854-976d-58bbdf906c76 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f565f8-ca7a-4f0f-b3a0-5277675bde65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec', 'volume_name': 'volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec', 'volume_size': 1, 'image_id': '0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--232109116', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b8bd1c86a714b089e46799fe2f17bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'created_at': datetime.datetime(2026, 11, 5, 11, 1, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 1, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0290388f0>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e1356d-3780-493a-ae05-220c8a12c2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e1356d-3780-493a-ae05-220c8a12c2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a210885-f3d2-4d5c-8b7b-d3d4d066fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:31 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Volume f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec', 'volume_size': 1, 'image_id': '0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--232109116', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b8bd1c86a714b089e46799fe2f17bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'created_at': datetime.datetime(2026, 11, 5, 11, 1, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 1, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0290388f0>}
Nov 05 12:01:31 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Trying to clone f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec from image 0be2ea54-3af4-44c8-a0c8-81d87f78813c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:01:32 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6 1073741824" returned: 0 in 1.720s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:32 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6
Nov 05 12:01:32 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:33 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6" returned: 0 in 0.932s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] <== create_volume: return (2823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.835s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-213824f4-445c-4bb7-8d65-29c26bc9e304 req-ec727c17-3773-4854-976d-58bbdf906c76 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-213824f4-445c-4bb7-8d65-29c26bc9e304 req-ec727c17-3773-4854-976d-58bbdf906c76 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc9b03b-95cf-4dd1-96ad-96b09ffdbfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f496248c-318a-412f-941c-fb9b03e33ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:33 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Volume volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6 (75c815ee-26da-4cdc-bc68-edd20cfe15e6): created successfully
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f496248c-318a-412f-941c-fb9b03e33ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Flow 'volume_create_manager' (6a335198-bc00-46d3-9e30-bdb915b4c22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5e854aac-56f3-42e9-862f-6611f0824749 tempest-TestInstancesWithCinderVolumes-625618561 None] Created volume successfully.
Nov 05 12:01:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-213824f4-445c-4bb7-8d65-29c26bc9e304 req-ec727c17-3773-4854-976d-58bbdf906c76 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-3457ade6-b004-423e-87a9-52f3d2cc20aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0c252db-a40d-4f0d-b5d3-f7a50b5c4885', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:01:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-213824f4-445c-4bb7-8d65-29c26bc9e304 req-ec727c17-3773-4854-976d-58bbdf906c76 tempest-TestServerVolumeAttachmentScenario-1797614666 None] attachment_update completed successfully.
Nov 05 12:01:40 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD, size 20.69 MB, duration 8.58 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:01:40 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Image download 20.69 MB at 2.41 MB/s
Nov 05 12:01:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e2746-37de-4b0c-9a07-5b2930376ed2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:40 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD
Nov 05 12:01:40 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Temporary image 0be2ea54-3af4-44c8-a0c8-81d87f78813c is fetched for user 242fb27bb36c4785897e2cc6deed0b4b. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf73032c-ae9e-492d-bd3e-ed320bca6d66]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:41 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD
Nov 05 12:01:41 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-9f1b7b65-3bc5-486b-ad00-cb5d744a10ca req-adb00717-193d-449e-b87e-d0c1a5428fa5 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-9f1b7b65-3bc5-486b-ad00-cb5d744a10ca req-adb00717-193d-449e-b87e-d0c1a5428fa5 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-9f1b7b65-3bc5-486b-ad00-cb5d744a10ca req-adb00717-193d-449e-b87e-d0c1a5428fa5 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-9f1b7b65-3bc5-486b-ad00-cb5d744a10ca req-adb00717-193d-449e-b87e-d0c1a5428fa5 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-ef0fe292-1d68-4a94-b096-07097b0c9427', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cf18aa4-b565-446c-95a8-1b5cb0dd6754', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:01:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-9f1b7b65-3bc5-486b-ad00-cb5d744a10ca req-adb00717-193d-449e-b87e-d0c1a5428fa5 tempest-TestServerVolumeAttachmentScenario-1797614666 None] attachment_update completed successfully.
Nov 05 12:01:41 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-593856000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8bd1c86a714b089e46799fe2f17bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:31Z,use_quota=True,user_id='242fb27bb36c4785897e2cc6deed0b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c197637d-ac45-4242-ba87-8e1a32299d9b),volume_type_id=c197637d-ac45-4242-ba87-8e1a32299d9b)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Creating volume f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:41 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:01:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:42 devstack sudo[96732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec 1073741824
Nov 05 12:01:42 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:42 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec 1073741824" returned: 0 in 0.758s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:42 devstack sudo[96740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec
Nov 05 12:01:42 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:43 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Attempting download of 0be2ea54-3af4-44c8-a0c8-81d87f78813c ((None, [{'url': 'file:///opt/stack/data/glance/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'metadata': {}}])) to volume f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd18f81a-94d9-4d48-a186-8bf9560ee175]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0be2ea54-3af4-44c8-a0c8-81d87f78813c_sinqqkm7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:43 devstack sudo[96743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0be2ea54-3af4-44c8-a0c8-81d87f78813c_sinqqkm7
Nov 05 12:01:43 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:43 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0be2ea54-3af4-44c8-a0c8-81d87f78813c_sinqqkm7" returned: 0 in 0.347s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0be2ea54-3af4-44c8-a0c8-81d87f78813c_sinqqkm7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:43 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0be2ea54-3af4-44c8-a0c8-81d87f78813c_sinqqkm7
Nov 05 12:01:43 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:43 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0be2ea54-3af4-44c8-a0c8-81d87f78813c_sinqqkm7" returned: 1 in 0.358s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0be2ea54-3af4-44c8-a0c8-81d87f78813c_sinqqkm7' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08c2aa7-07be-4da4-abeb-d1d505e90d35]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:44 devstack sudo[96753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD
Nov 05 12:01:44 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:44 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:44 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] 0be2ea54-3af4-44c8-a0c8-81d87f78813c was qcow2, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:01:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:44 devstack sudo[96828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec
Nov 05 12:01:44 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-b28e8ee8-afc6-49ce-8804-0add97491e38 req-85f6908b-ef21-4410-a1c4-f82b4d460c6c tempest-TestServerVolumeAttachmentScenario-1797614666 None] Terminate volume connection completed successfully.
Nov 05 12:01:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-b28e8ee8-afc6-49ce-8804-0add97491e38 req-85f6908b-ef21-4410-a1c4-f82b4d460c6c tempest-TestServerVolumeAttachmentScenario-1797614666 None] Deleting attachment 2cf18aa4-b565-446c-95a8-1b5cb0dd6754. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:01:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-f6913db7-4599-4f3d-b4fd-d5b2ffbc2467 req-f23a6c1c-c321-4084-b578-6234fc45fba3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Terminate volume connection completed successfully.
Nov 05 12:01:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-f6913db7-4599-4f3d-b4fd-d5b2ffbc2467 req-f23a6c1c-c321-4084-b578-6234fc45fba3 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Deleting attachment b0c252db-a40d-4f0d-b5d3-f7a50b5c4885. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:01:46 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec" returned: 0 in 2.414s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:46 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0be2ea54-3af4-44c8-a0c8-81d87f78813c_bst3nzevdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:01:46 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Converted 112.00 MB image at 46.37 MB/s
Nov 05 12:01:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:46 devstack sudo[96868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec 1G
Nov 05 12:01:46 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:47 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec 1G" returned: 0 in 0.361s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Downloaded image 0be2ea54-3af4-44c8-a0c8-81d87f78813c ((None, [{'url': 'file:///opt/stack/data/glance/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'metadata': {}}])) to volume f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Temporary image 0be2ea54-3af4-44c8-a0c8-81d87f78813c for user 242fb27bb36c4785897e2cc6deed0b4b is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Marking volume f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Copying metadata from image 0be2ea54-3af4-44c8-a0c8-81d87f78813c to f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Creating volume glance metadata for volume f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec backed by image 0be2ea54-3af4-44c8-a0c8-81d87f78813c with: {'image_id': '0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'image_name': 'tempest-scenario-img--232109116', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a210885-f3d2-4d5c-8b7b-d3d4d066fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec', 'volume_size': 1, 'image_id': '0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--232109116', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b8bd1c86a714b089e46799fe2f17bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0be2ea54-3af4-44c8-a0c8-81d87f78813c', 'created_at': datetime.datetime(2026, 11, 5, 11, 1, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 1, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0be2ea54-3af4-44c8-a0c8-81d87f78813c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0290388f0>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7949d8-5dde-4b43-9fc4-6e933daa9b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:47 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Volume volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec (f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec): created successfully
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7949d8-5dde-4b43-9fc4-6e933daa9b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Flow 'volume_create_manager' (d6b2d07b-25a3-4419-bb8c-74c894b82f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e5d04660-95cd-4fb9-94e1-dce2a9f856ee tempest-TestInstancesWithCinderVolumes-625618561 None] Created volume successfully.
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "cinder-ef0fe292-1d68-4a94-b096-07097b0c9427-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-ef0fe292-1d68-4a94-b096-07097b0c9427-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "cinder-quobyte-ef0fe292-1d68-4a94-b096-07097b0c9427" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-83761ecf-2697-4598-9cdd-43a531e7423a req-776ba9cd-6b1d-441a-8924-8d8bdc1bc416 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-83761ecf-2697-4598-9cdd-43a531e7423a req-776ba9cd-6b1d-441a-8924-8d8bdc1bc416 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-quobyte-ef0fe292-1d68-4a94-b096-07097b0c9427" acquired by "delete_volume" :: waited 0.033s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-83761ecf-2697-4598-9cdd-43a531e7423a req-776ba9cd-6b1d-441a-8924-8d8bdc1bc416 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e996ff59-7e86-4ebc-82b4-194141570bf8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-83761ecf-2697-4598-9cdd-43a531e7423a req-776ba9cd-6b1d-441a-8924-8d8bdc1bc416 tempest-TestInstancesWithCinderVolumes-625618561 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e4daee1-95a3-464a-ae2c-5afbdd83ffdd', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:01:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-83761ecf-2697-4598-9cdd-43a531e7423a req-776ba9cd-6b1d-441a-8924-8d8bdc1bc416 tempest-TestInstancesWithCinderVolumes-625618561 None] attachment_update completed successfully.
Nov 05 12:01:51 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427
Nov 05 12:01:51 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:52 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427" returned: 0 in 0.657s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:52 devstack sudo[96929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427
Nov 05 12:01:52 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:52 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ef0fe292-1d68-4a94-b096-07097b0c9427" returned: 0 in 0.337s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-quobyte-ef0fe292-1d68-4a94-b096-07097b0c9427" released by "delete_volume" :: held 1.076s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Created reservations ['c072c3f9-22a6-4025-b4ec-9ffcab2d1949', '8bd52031-2cd8-41ac-a77e-c17aa6da7466', '408db77d-dfcc-4a9d-89e5-27b93cff38bc', '53777ea5-f43b-4b3d-99fd-0907413679e0'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:53 devstack sudo[96932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:01:53 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:53 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.303s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:53 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Deleted volume successfully.
Nov 05 12:01:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b33b1fa7-c1fd-41a4-a66a-24d9b0df38f8 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-ef0fe292-1d68-4a94-b096-07097b0c9427-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "cinder-3457ade6-b004-423e-87a9-52f3d2cc20aa-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-3457ade6-b004-423e-87a9-52f3d2cc20aa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "cinder-quobyte-3457ade6-b004-423e-87a9-52f3d2cc20aa" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-quobyte-3457ade6-b004-423e-87a9-52f3d2cc20aa" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[889c3742-4c8f-484a-b270-a4f60ec737ac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:54 devstack sudo[96937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa
Nov 05 12:01:54 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:54 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa" returned: 0 in 0.604s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:54 devstack sudo[97021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa
Nov 05 12:01:54 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:55 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3457ade6-b004-423e-87a9-52f3d2cc20aa" returned: 0 in 0.585s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-quobyte-3457ade6-b004-423e-87a9-52f3d2cc20aa" released by "delete_volume" :: held 1.267s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Created reservations ['f64a108e-aee4-4c98-904b-0ee4ca06cd9d', '212169bc-ed49-474a-bb03-5d32516a570e', '1ae9dead-8426-4398-a1b4-f9d3436187c6', '3d4ea5d8-aa44-417d-abdf-deefb18e2a18'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:55 devstack sudo[97298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:01:55 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:56 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.502s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:01:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Deleted volume successfully.
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c642c77e-2e4b-4f0d-8a67-a0f004a4ab60 tempest-TestServerVolumeAttachmentScenario-1797614666 None] Lock "cinder-3457ade6-b004-423e-87a9-52f3d2cc20aa-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Flow 'volume_create_manager' (9d78937a-350e-463a-809b-02dcdcb7a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63170b5-bcc1-4655-8ffa-30eb711b3d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63170b5-bcc1-4655-8ffa-30eb711b3d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-447876508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444f98e9-0c14-4586-a2b7-383299306b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9333fb17713a4ed4903b4400dc48a277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:57Z,use_quota=True,user_id='c5bf6cfb10314627905b4ebef15be500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91a93ad-ff63-4652-b1fd-c85619de2111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91a93ad-ff63-4652-b1fd-c85619de2111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dc6f39-a083-4fa5-8267-da5f800cb4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dc6f39-a083-4fa5-8267-da5f800cb4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444f98e9-0c14-4586-a2b7-383299306b44', 'volume_name': 'volume-444f98e9-0c14-4586-a2b7-383299306b44', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db10493b-ba55-43c1-b46f-69b89d44a67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db10493b-ba55-43c1-b46f-69b89d44a67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec1acde-959d-4f19-8816-213b20b57384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Volume 444f98e9-0c14-4586-a2b7-383299306b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444f98e9-0c14-4586-a2b7-383299306b44', 'volume_size': 1}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-447876508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444f98e9-0c14-4586-a2b7-383299306b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9333fb17713a4ed4903b4400dc48a277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:57Z,use_quota=True,user_id='c5bf6cfb10314627905b4ebef15be500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Creating volume 444f98e9-0c14-4586-a2b7-383299306b44 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:57 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:57 devstack sudo[97438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44 1073741824
Nov 05 12:01:57 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Flow 'volume_create_manager' (0498fad4-c20c-4670-a6ba-bced19f997b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e392fe5a-a951-4ae5-919d-edfedf1d697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e392fe5a-a951-4ae5-919d-edfedf1d697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-880477711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48209837-bdd1-4885-ae60-e74d815fa614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea507c70a15446cb980c504c59da073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:57Z,use_quota=True,user_id='89436e30ae544a24b3779a942061b23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ca67f9-88f1-4eaa-9d48-5e43de39d430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ca67f9-88f1-4eaa-9d48-5e43de39d430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f2a798-3279-42ed-a18f-2a2729cb929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f2a798-3279-42ed-a18f-2a2729cb929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48209837-bdd1-4885-ae60-e74d815fa614', 'volume_name': 'volume-48209837-bdd1-4885-ae60-e74d815fa614', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d523a56-8dc1-4159-84b6-fc1f33bf8ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d523a56-8dc1-4159-84b6-fc1f33bf8ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9027f73-22ea-41e1-ae82-14897e471220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Volume 48209837-bdd1-4885-ae60-e74d815fa614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48209837-bdd1-4885-ae60-e74d815fa614', 'volume_size': 1}
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:57 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44 1073741824" returned: 0 in 0.938s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:58 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44
Nov 05 12:01:58 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:58 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44" returned: 0 in 0.454s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-880477711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48209837-bdd1-4885-ae60-e74d815fa614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea507c70a15446cb980c504c59da073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:01:57Z,use_quota=True,user_id='89436e30ae544a24b3779a942061b23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Creating volume 48209837-bdd1-4885-ae60-e74d815fa614 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:01:58 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec1acde-959d-4f19-8816-213b20b57384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444f98e9-0c14-4586-a2b7-383299306b44', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d7ccbc-fa75-4bbf-91b9-3bb6c60c3b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:01:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Volume volume-444f98e9-0c14-4586-a2b7-383299306b44 (444f98e9-0c14-4586-a2b7-383299306b44): created successfully
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d7ccbc-fa75-4bbf-91b9-3bb6c60c3b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:01:58 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614 1073741824
Nov 05 12:01:58 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:01:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Flow 'volume_create_manager' (9d78937a-350e-463a-809b-02dcdcb7a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:01:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5157af57-a850-4bcd-bff0-7038a6f1d152 tempest-AttachVolumeTestJSON-790998958 None] Created volume successfully.
Nov 05 12:01:59 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Nov 05 12:01:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614 1073741824" returned: 0 in 1.062s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:01:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:01:59 devstack sudo[97458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614
Nov 05 12:01:59 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-71f09a26-ffe4-4b9b-9272-11c830a31920 req-fafa4d48-3bd4-495d-ae08-fa002055a14f tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:00 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614" returned: 0 in 0.903s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-71f09a26-ffe4-4b9b-9272-11c830a31920 req-fafa4d48-3bd4-495d-ae08-fa002055a14f tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.041s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9027f73-22ea-41e1-ae82-14897e471220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48209837-bdd1-4885-ae60-e74d815fa614', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f1d131-c4be-481e-b9c4-329465b84efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-71f09a26-ffe4-4b9b-9272-11c830a31920 req-fafa4d48-3bd4-495d-ae08-fa002055a14f tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.086s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:00 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Volume volume-48209837-bdd1-4885-ae60-e74d815fa614 (48209837-bdd1-4885-ae60-e74d815fa614): created successfully
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f1d131-c4be-481e-b9c4-329465b84efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Flow 'volume_create_manager' (0498fad4-c20c-4670-a6ba-bced19f997b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:00 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1dd46252-46c4-487c-9004-994058b22085 tempest-AttachVolumeNegativeTest-1143206013 None] Created volume successfully.
Nov 05 12:02:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-71f09a26-ffe4-4b9b-9272-11c830a31920 req-fafa4d48-3bd4-495d-ae08-fa002055a14f tempest-AttachVolumeTestJSON-790998958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-444f98e9-0c14-4586-a2b7-383299306b44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa023972-6b8a-49fa-a683-420b73c96dcf', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:02:00 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-71f09a26-ffe4-4b9b-9272-11c830a31920 req-fafa4d48-3bd4-495d-ae08-fa002055a14f tempest-AttachVolumeTestJSON-790998958 None] attachment_update completed successfully.
Nov 05 12:02:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-95ff4082-1ee7-4963-adf6-c98ae77fdf34 req-388af119-f987-42eb-ba67-ce47ca830b79 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-95ff4082-1ee7-4963-adf6-c98ae77fdf34 req-388af119-f987-42eb-ba67-ce47ca830b79 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-95ff4082-1ee7-4963-adf6-c98ae77fdf34 req-388af119-f987-42eb-ba67-ce47ca830b79 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-95ff4082-1ee7-4963-adf6-c98ae77fdf34 req-388af119-f987-42eb-ba67-ce47ca830b79 tempest-AttachVolumeNegativeTest-1143206013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-48209837-bdd1-4885-ae60-e74d815fa614', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4aac1a64-2546-48cb-901f-cffef5bb834b', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:02:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-95ff4082-1ee7-4963-adf6-c98ae77fdf34 req-388af119-f987-42eb-ba67-ce47ca830b79 tempest-AttachVolumeNegativeTest-1143206013 None] attachment_update completed successfully.
Nov 05 12:02:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-22282139-7c2e-462b-b3c8-9047559e1eb8 req-bf8e052c-cc34-4af9-aedb-6e8e0037cf5b tempest-AttachVolumeNegativeTest-1143206013 None] Terminate volume connection completed successfully.
Nov 05 12:02:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-22282139-7c2e-462b-b3c8-9047559e1eb8 req-bf8e052c-cc34-4af9-aedb-6e8e0037cf5b tempest-AttachVolumeNegativeTest-1143206013 None] Deleting attachment 4aac1a64-2546-48cb-901f-cffef5bb834b. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:02:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:02:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:13 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:13 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:14 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.814s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:02:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:02:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:02:17 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=39,cinder:SELECT=61,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:02:17 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=62,cinder:UPDATE=42,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:02:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "cinder-48209837-bdd1-4885-ae60-e74d815fa614-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-48209837-bdd1-4885-ae60-e74d815fa614-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "cinder-quobyte-48209837-bdd1-4885-ae60-e74d815fa614" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-quobyte-48209837-bdd1-4885-ae60-e74d815fa614" acquired by "delete_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8b4415-d7c0-4c88-aaed-295e8af552b1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:20 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614
Nov 05 12:02:20 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:20 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614" returned: 0 in 0.554s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:20 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614
Nov 05 12:02:20 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:20 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-48209837-bdd1-4885-ae60-e74d815fa614" returned: 0 in 0.391s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-quobyte-48209837-bdd1-4885-ae60-e74d815fa614" released by "delete_volume" :: held 1.064s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Created reservations ['1b0becbf-3184-4d34-a6b8-3d037d0a8945', 'a9959be7-187b-456c-8b38-66aa32dc3d4d', '535687cc-a0cc-4d3f-bad7-55a4a81337af', '47580604-a3ab-4370-92df-377da8c4671e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:21 devstack sudo[97717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:21 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:21 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.403s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Deleted volume successfully.
Nov 05 12:02:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-415deaf0-c198-4311-b171-82736bd2791d tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-48209837-bdd1-4885-ae60-e74d815fa614-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "cinder-50241b49-c78a-4a29-8328-d5b1aae7f4dc-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-50241b49-c78a-4a29-8328-d5b1aae7f4dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "cinder-quobyte-50241b49-c78a-4a29-8328-d5b1aae7f4dc" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-quobyte-50241b49-c78a-4a29-8328-d5b1aae7f4dc" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d33d2f6-7fe1-42f1-9f45-e30b2475be60]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:22 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc
Nov 05 12:02:22 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:22 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc" returned: 0 in 0.545s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:22 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc
Nov 05 12:02:22 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:23 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-50241b49-c78a-4a29-8328-d5b1aae7f4dc" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-quobyte-50241b49-c78a-4a29-8328-d5b1aae7f4dc" released by "delete_volume" :: held 0.911s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Created reservations ['3f0a5a7c-5940-4f59-b2b2-860b73dfe1bb', 'db9cde10-7a76-4c4b-88d5-22db1d5bd25d', 'b232d094-dd8a-4aba-b460-5c77f00acff5', 'f87ef88c-eaba-4bac-8a4d-3e7b87b4de62'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:23 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:23 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:23 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.323s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Deleted volume successfully.
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "cinder-4c25a3b6-0f4f-4b2a-8e35-884bb4129225-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-4c25a3b6-0f4f-4b2a-8e35-884bb4129225-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-089457dc-6348-4cd5-af55-ec3c6aba8fe3 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-50241b49-c78a-4a29-8328-d5b1aae7f4dc-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "cinder-quobyte-4c25a3b6-0f4f-4b2a-8e35-884bb4129225" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-quobyte-4c25a3b6-0f4f-4b2a-8e35-884bb4129225" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3599f1-f11c-48b2-ad98-308a3428eba9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:24 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225
Nov 05 12:02:24 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:24 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225" returned: 0 in 0.414s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:24 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225
Nov 05 12:02:24 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:24 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4c25a3b6-0f4f-4b2a-8e35-884bb4129225" returned: 0 in 0.341s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-quobyte-4c25a3b6-0f4f-4b2a-8e35-884bb4129225" released by "delete_volume" :: held 0.812s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Created reservations ['cec85da2-1254-4b0c-b289-0df398e525b0', '827dfc09-23d8-46f8-b96c-98ccd11f4832', 'af62b4d3-0097-4310-a287-23dd53914f4a', '7e7a356c-a573-41d3-9bb5-9684c5a883a3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:25 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:25 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:25 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.519s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:25 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Deleted volume successfully.
Nov 05 12:02:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-68f133f5-1631-48a4-be7b-68e90105ac90 tempest-AttachVolumeNegativeTest-1143206013 None] Lock "cinder-4c25a3b6-0f4f-4b2a-8e35-884bb4129225-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Flow 'volume_create_manager' (c978e939-27a6-4a01-8250-0da453c0732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da922e1b-8be7-4892-b990-31c6a2e48cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da922e1b-8be7-4892-b990-31c6a2e48cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d30845b18904466ae1ca13b67aa9f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:27Z,use_quota=True,user_id='a297a4629a4644f3b406eaee61a52777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0feeb6f-0d35-4f42-a17c-5a715c3666ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0feeb6f-0d35-4f42-a17c-5a715c3666ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20f89f9-518f-4976-8e42-7b38f8ad746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20f89f9-518f-4976-8e42-7b38f8ad746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa', 'volume_name': 'volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa', 'volume_size': 1, 'image_id': '2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad671f4905d6a36398a2ba1915e3c0ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d30845b18904466ae1ca13b67aa9f2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a60a35c9ddb893902d20379b1f937674a9fce40d9f54d1f1bc92d89de5a4c31abfd6c1539c0fd74430081387f4060efaa989b161079701bf16cab9fba15c9bf9', 'id': '2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01eab00e0>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665d4270-dde3-4a17-a7aa-a7ecef120307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665d4270-dde3-4a17-a7aa-a7ecef120307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e394e4-2efb-4c4f-afb9-151c31a521c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Volume 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa', 'volume_size': 1, 'image_id': '2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad671f4905d6a36398a2ba1915e3c0ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d30845b18904466ae1ca13b67aa9f2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a60a35c9ddb893902d20379b1f937674a9fce40d9f54d1f1bc92d89de5a4c31abfd6c1539c0fd74430081387f4060efaa989b161079701bf16cab9fba15c9bf9', 'id': '2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01eab00e0>}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Trying to clone 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa from image 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:02:27 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad948f47-d379-4c3b-964f-aa084a122b7b]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:27 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD
Nov 05 12:02:27 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:28 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD" returned: 0 in 0.561s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:28 devstack sudo[97756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD
Nov 05 12:02:28 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:28 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:28 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Temporary image 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 is fetched for user a297a4629a4644f3b406eaee61a52777. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:02:28 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f4ee2-1952-4c8c-9e47-5176a3db1af0]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:28 devstack sudo[97763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD
Nov 05 12:02:29 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:29 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:29 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD
Nov 05 12:02:29 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:29 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD" returned: 1 in 0.488s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d30845b18904466ae1ca13b67aa9f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:27Z,use_quota=True,user_id='a297a4629a4644f3b406eaee61a52777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Creating volume 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:29 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:02:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:29 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa 1073741824
Nov 05 12:02:29 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:30 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa 1073741824" returned: 0 in 0.642s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:30 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa
Nov 05 12:02:30 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-be4ea661-c2df-4c71-9552-085dc0e9c166 req-44f15b1d-ecb3-4453-8bc2-84d13aba350f tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:30 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa" returned: 0 in 0.399s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-be4ea661-c2df-4c71-9552-085dc0e9c166 req-44f15b1d-ecb3-4453-8bc2-84d13aba350f tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.244s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-be4ea661-c2df-4c71-9552-085dc0e9c166 req-44f15b1d-ecb3-4453-8bc2-84d13aba350f tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:31 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Attempting download of 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'metadata': {}}])) to volume 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:02:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-be4ea661-c2df-4c71-9552-085dc0e9c166 req-44f15b1d-ecb3-4453-8bc2-84d13aba350f tempest-TestInstancesWithCinderVolumes-625618561 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-211fba56-f557-4df4-9a19-31511dbe701e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8536ef9-7d2b-477c-b38e-9eaaccccc81f', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:02:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf160db-f056-487b-b4bf-78d0a09a5742]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_az371vzi {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:31 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-be4ea661-c2df-4c71-9552-085dc0e9c166 req-44f15b1d-ecb3-4453-8bc2-84d13aba350f tempest-TestInstancesWithCinderVolumes-625618561 None] attachment_update completed successfully.
Nov 05 12:02:31 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_az371vzi
Nov 05 12:02:31 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:31 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_az371vzi" returned: 0 in 0.661s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_az371vzi {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:31 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_az371vzi
Nov 05 12:02:31 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:32 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_az371vzi" returned: 1 in 0.449s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_az371vzi' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:32 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d417d8-ef38-49ff-b5d1-a8323182bde0]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:32 devstack sudo[97803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD
Nov 05 12:02:32 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:32 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:32 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD
Nov 05 12:02:32 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:33 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:02:33 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 was raw, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:02:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:33 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa
Nov 05 12:02:33 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:33 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa" returned: 0 in 0.785s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:33 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f588ae2-2c7f-4ce0-abe8-709a43e4fa72_1xinllrvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:02:33 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:02:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:33 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa 1G
Nov 05 12:02:34 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-62e3daf1-8189-48a9-a804-70d63577277e req-ecc7d57f-1284-4401-ac4e-6dca4ff3d583 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-62e3daf1-8189-48a9-a804-70d63577277e req-ecc7d57f-1284-4401-ac4e-6dca4ff3d583 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-62e3daf1-8189-48a9-a804-70d63577277e req-ecc7d57f-1284-4401-ac4e-6dca4ff3d583 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-62e3daf1-8189-48a9-a804-70d63577277e req-ecc7d57f-1284-4401-ac4e-6dca4ff3d583 tempest-TestInstancesWithCinderVolumes-625618561 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8aeaf18e-892e-4f4c-a781-66cc0afd19c9', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:02:34 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa 1G" returned: 0 in 0.386s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Downloaded image 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'metadata': {}}])) to volume 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Temporary image 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 for user a297a4629a4644f3b406eaee61a52777 is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Marking volume 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Copying metadata from image 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 to 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Creating volume glance metadata for volume 536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa backed by image 2f588ae2-2c7f-4ce0-abe8-709a43e4fa72 with: {'image_id': '2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ad671f4905d6a36398a2ba1915e3c0ac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:02:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-62e3daf1-8189-48a9-a804-70d63577277e req-ecc7d57f-1284-4401-ac4e-6dca4ff3d583 tempest-TestInstancesWithCinderVolumes-625618561 None] attachment_update completed successfully.
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e394e4-2efb-4c4f-afb9-151c31a521c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa', 'volume_size': 1, 'image_id': '2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad671f4905d6a36398a2ba1915e3c0ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d30845b18904466ae1ca13b67aa9f2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a60a35c9ddb893902d20379b1f937674a9fce40d9f54d1f1bc92d89de5a4c31abfd6c1539c0fd74430081387f4060efaa989b161079701bf16cab9fba15c9bf9', 'id': '2f588ae2-2c7f-4ce0-abe8-709a43e4fa72', 'created_at': datetime.datetime(2026, 11, 5, 11, 2, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 2, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f588ae2-2c7f-4ce0-abe8-709a43e4fa72/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01eab00e0>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea2744-6ca6-427d-b9d4-5d34c749b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Volume volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa (536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa): created successfully
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea2744-6ca6-427d-b9d4-5d34c749b692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Flow 'volume_create_manager' (c978e939-27a6-4a01-8250-0da453c0732a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e864b70a-f651-4ae2-9e66-879b53b7156f tempest-VolumeImageDependencyTests-1308490501 None] Created volume successfully.
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Acquiring lock "cinder-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Lock "cinder-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Acquiring lock "cinder-quobyte-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Lock "cinder-quobyte-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d4c00e-f836-4efc-9941-d95bbc7b450c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:35 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa
Nov 05 12:02:35 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:35 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa" returned: 0 in 0.418s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:35 devstack sudo[97863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa
Nov 05 12:02:35 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:35 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Lock "cinder-quobyte-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa" released by "delete_volume" :: held 0.724s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Created reservations ['08cbeaa3-2da6-45e5-abe4-588f2b568c97', 'b91fd2c6-a6ee-4293-88a8-e433c5859a15', '61d2c6a8-64b1-4b75-a9cb-e932b2c0e03a', '7c742d8d-155c-46fe-9fac-9873bda6754f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:35 devstack sudo[97866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:35 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:36 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.335s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:36 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:36 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Deleted volume successfully.
Nov 05 12:02:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3effd4bf-978b-4c91-8852-ff128433cf38 tempest-VolumeImageDependencyTests-1308490501 None] Lock "cinder-536b0a2a-eb8b-4a30-9ffe-8fe6dd33d4fa-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Flow 'volume_create_manager' (d7aa19e8-2e6f-436e-879e-8cceb37a3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1476e8-89d1-492f-be1c-7abf098d7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1476e8-89d1-492f-be1c-7abf098d7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-232229546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe09c6c0-f252-43c0-9089-0d4768453372,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f6940dd6c30146b6bfecdfa4d56c60d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:37Z,use_quota=True,user_id='f9ec2292a49642b9851e381ea154bd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5870e2af-8cbd-435c-bda7-0e087bae6453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5870e2af-8cbd-435c-bda7-0e087bae6453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352c2121-adaf-46bb-b19f-30b178fcf1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352c2121-adaf-46bb-b19f-30b178fcf1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe09c6c0-f252-43c0-9089-0d4768453372', 'volume_name': 'volume-fe09c6c0-f252-43c0-9089-0d4768453372', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df97bd3e-2c75-4bb4-ab33-ec39ead61741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df97bd3e-2c75-4bb4-ab33-ec39ead61741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6fc89b-8932-40f9-aee2-8e16639fefd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Volume fe09c6c0-f252-43c0-9089-0d4768453372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe09c6c0-f252-43c0-9089-0d4768453372', 'volume_size': 1}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-232229546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe09c6c0-f252-43c0-9089-0d4768453372,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f6940dd6c30146b6bfecdfa4d56c60d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:02:37Z,use_quota=True,user_id='f9ec2292a49642b9851e381ea154bd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Creating volume fe09c6c0-f252-43c0-9089-0d4768453372 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:02:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:37 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372 1073741824
Nov 05 12:02:37 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:37 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372 1073741824" returned: 0 in 0.611s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:38 devstack sudo[97883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372
Nov 05 12:02:38 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:38 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372" returned: 0 in 0.421s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:02:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6fc89b-8932-40f9-aee2-8e16639fefd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe09c6c0-f252-43c0-9089-0d4768453372', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6c2ee8-12fa-4e21-9eb5-d875c4ab4a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:02:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Volume volume-fe09c6c0-f252-43c0-9089-0d4768453372 (fe09c6c0-f252-43c0-9089-0d4768453372): created successfully
Nov 05 12:02:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6c2ee8-12fa-4e21-9eb5-d875c4ab4a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:02:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Flow 'volume_create_manager' (d7aa19e8-2e6f-436e-879e-8cceb37a3184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:02:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-2b92a15b-2de3-4fac-aa29-ecda6f744ba8 req-50cbe875-6762-46e7-94db-a75d8c3c04b6 tempest-VolumesGetTestJSON-1302416127 None] Created volume successfully.
Nov 05 12:02:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Acquiring lock "cinder-fe09c6c0-f252-43c0-9089-0d4768453372-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Lock "cinder-fe09c6c0-f252-43c0-9089-0d4768453372-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Acquiring lock "cinder-quobyte-fe09c6c0-f252-43c0-9089-0d4768453372" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Lock "cinder-quobyte-fe09c6c0-f252-43c0-9089-0d4768453372" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545ec8d-1d82-4901-81dd-8cce4459aed6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:40 devstack sudo[97909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372
Nov 05 12:02:40 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:41 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372" returned: 0 in 0.703s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:41 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372
Nov 05 12:02:41 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:41 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fe09c6c0-f252-43c0-9089-0d4768453372" returned: 0 in 0.405s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Lock "cinder-quobyte-fe09c6c0-f252-43c0-9089-0d4768453372" released by "delete_volume" :: held 1.206s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG cinder.quota [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Created reservations ['5630bef6-c51f-4785-825a-732bcd531e62', '4fc4f966-1391-45d5-ac84-54e5002358c5', '4456a762-5996-4545-a168-0c0e2fb75c93', '7dfb9c56-a60b-4dc4-9d38-f6e3c90f39a1'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-116cabc6-1c0e-4e28-809e-83ac2e2eafbd req-65f660c0-7f88-4b3a-9bc0-a0b7bebdc942 tempest-TestInstancesWithCinderVolumes-625618561 None] Terminate volume connection completed successfully.
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-116cabc6-1c0e-4e28-809e-83ac2e2eafbd req-65f660c0-7f88-4b3a-9bc0-a0b7bebdc942 tempest-TestInstancesWithCinderVolumes-625618561 None] Deleting attachment a8536ef9-7d2b-477c-b38e-9eaaccccc81f. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:41 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:41 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "cinder-211fba56-f557-4df4-9a19-31511dbe701e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-211fba56-f557-4df4-9a19-31511dbe701e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:42 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.487s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG cinder.manager [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Deleted volume successfully.
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "cinder-quobyte-211fba56-f557-4df4-9a19-31511dbe701e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-067322cc-8c6c-4d9d-a863-20240b0817d4 req-05457a1a-10bf-4629-b688-f5092afa5bad tempest-VolumesGetTestJSON-1302416127 None] Lock "cinder-fe09c6c0-f252-43c0-9089-0d4768453372-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-quobyte-211fba56-f557-4df4-9a19-31511dbe701e" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf5075d-22bb-4071-95ba-0b15b8dc68eb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-4a027946-513b-485f-9a6b-56e9a9190e31 req-37a49ccf-e497-417d-9aac-5025c8d260f9 tempest-AttachVolumeTestJSON-790998958 None] Terminate volume connection completed successfully.
Nov 05 12:02:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-4a027946-513b-485f-9a6b-56e9a9190e31 req-37a49ccf-e497-417d-9aac-5025c8d260f9 tempest-AttachVolumeTestJSON-790998958 None] Deleting attachment fa023972-6b8a-49fa-a683-420b73c96dcf. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:02:42 devstack sudo[97932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e
Nov 05 12:02:42 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:43 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e" returned: 0 in 0.704s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:43 devstack sudo[97937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e
Nov 05 12:02:43 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:43 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-211fba56-f557-4df4-9a19-31511dbe701e" returned: 0 in 0.650s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-quobyte-211fba56-f557-4df4-9a19-31511dbe701e" released by "delete_volume" :: held 1.448s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:43 devstack cinder-volume[87317]: WARNING cinder.quota [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703592210-1265760068 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703592210-1265760068, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:43 devstack cinder-volume[87317]: WARNING cinder.quota [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703592210-1265760068 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703592210-1265760068, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Created reservations ['2a9b7926-6ec2-4e8e-8b50-8a8bdd38171a', 'd7675a06-4dd9-4c1a-8e2d-08f6dd4d9d75', 'd81cd9df-f4d8-457b-8c80-c560d5ca2d7d', 'fb2e850a-9270-4244-833a-33382d4ae57f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:44 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:44 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:44 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.375s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Deleted volume successfully.
Nov 05 12:02:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5875022-b6eb-4800-ae64-2c4730c4b8ae tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-211fba56-f557-4df4-9a19-31511dbe701e-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-fa491257-ace5-40ce-8932-d0e4f88d804a req-c4e19180-160a-4e02-be48-41901de0167f tempest-TestInstancesWithCinderVolumes-625618561 None] Terminate volume connection completed successfully.
Nov 05 12:02:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-fa491257-ace5-40ce-8932-d0e4f88d804a req-c4e19180-160a-4e02-be48-41901de0167f tempest-TestInstancesWithCinderVolumes-625618561 None] Deleting attachment 8aeaf18e-892e-4f4c-a781-66cc0afd19c9. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:02:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "cinder-75c815ee-26da-4cdc-bc68-edd20cfe15e6-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-75c815ee-26da-4cdc-bc68-edd20cfe15e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "cinder-quobyte-75c815ee-26da-4cdc-bc68-edd20cfe15e6" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-quobyte-75c815ee-26da-4cdc-bc68-edd20cfe15e6" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e344b3f-c4ad-4287-9cdc-010697b6dfa6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:48 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6
Nov 05 12:02:48 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:49 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6" returned: 0 in 1.020s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:49 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6
Nov 05 12:02:49 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:50 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-75c815ee-26da-4cdc-bc68-edd20cfe15e6" returned: 0 in 0.557s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-quobyte-75c815ee-26da-4cdc-bc68-edd20cfe15e6" released by "delete_volume" :: held 1.713s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:50 devstack cinder-volume[87317]: WARNING cinder.quota [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109463472-352596959 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109463472-352596959, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:50 devstack cinder-volume[87317]: WARNING cinder.quota [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109463472-352596959 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109463472-352596959, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Created reservations ['2ddb046e-38c7-4f4c-8393-fa8889d04483', '9daf8ecb-f792-4560-8439-0130f0cc5864', '62c58400-7f9d-459f-8919-305a6765b108', '1cf8fd54-e27a-42b7-9a94-a639818c727f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:02:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:50 devstack sudo[98071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:02:50 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:02:51 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root
Nov 05 12:02:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.504s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:02:51 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:02:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Deleted volume successfully.
Nov 05 12:02:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8a5e578a-7984-4315-bb87-b4aca43026b2 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-75c815ee-26da-4cdc-bc68-edd20cfe15e6-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:02:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-86204f0e-8d4a-4a62-8e39-73eead4d1cc0 req-93ac3fea-06cf-4fa1-a63d-74ceef4368d7 tempest-TestInstancesWithCinderVolumes-625618561 None] Terminate volume connection completed successfully.
Nov 05 12:02:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-86204f0e-8d4a-4a62-8e39-73eead4d1cc0 req-93ac3fea-06cf-4fa1-a63d-74ceef4368d7 tempest-TestInstancesWithCinderVolumes-625618561 None] Deleting attachment 0e4daee1-95a3-464a-ae2c-5afbdd83ffdd. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:02:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "cinder-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "cinder-quobyte-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:02:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-quobyte-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:02:59 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba952df-5a61-436f-9724-021b39d87b6f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:02:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:02:59 devstack sudo[98118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec
Nov 05 12:02:59 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:00 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec" returned: 0 in 0.733s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:00 devstack sudo[98123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec
Nov 05 12:03:00 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:00 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec" returned: 0 in 0.575s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-quobyte-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec" released by "delete_volume" :: held 1.384s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:00 devstack cinder-volume[87317]: WARNING cinder.quota [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023580510-1744398259 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023580510-1744398259, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:03:00 devstack cinder-volume[87317]: WARNING cinder.quota [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023580510-1744398259 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1023580510-1744398259, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:03:00 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Created reservations ['c299201e-5792-4018-b329-62dadcf7cb6b', '90ebda00-4368-4d88-86cc-108523152253', 'ccfde7f3-2b93-415e-91c7-d14fb16ad94b', '0222a279-5942-4584-911f-31b0ace12f51'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:01 devstack sudo[98126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:03:01 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:01 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.542s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Deleted volume successfully.
Nov 05 12:03:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d0cc88de-c6e5-4ee4-b67d-50ef67adf4a5 tempest-TestInstancesWithCinderVolumes-625618561 None] Lock "cinder-f2cff0b2-b3be-445c-a9c1-8687d9f4b7ec-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2c9bce80-a809-499d-ace8-737ddfdbd150 tempest-GroupsV320Test-1225192959 None] Group tempest-GroupsV320Test-Group-1522432251: creating
Nov 05 12:03:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2c9bce80-a809-499d-ace8-737ddfdbd150 tempest-GroupsV320Test-1225192959 None] Group tempest-GroupsV320Test-Group-1522432251: created successfully
Nov 05 12:03:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2c9bce80-a809-499d-ace8-737ddfdbd150 tempest-GroupsV320Test-1225192959 None] Create group completed successfully.
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Created reservations ['5a249f69-c8fa-474d-936b-d1f3f8553667'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:07 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:03:07 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:07 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.297s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:07 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1c28ade2-08ec-4f79-ad23-0c1953c58c65 tempest-GroupsV320Test-1225192959 None] Delete group completed successfully.
Nov 05 12:03:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:03:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:13 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:03:13 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:14 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.400s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:03:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:03:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:03:17 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=86,cinder:DELETE=7 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:03:17 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=70,cinder:SELECT=69,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Flow 'volume_create_manager' (3c149528-ea55-41dd-b5e6-26225032aa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56388a9-024b-4e13-a6c3-00a08b063f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56388a9-024b-4e13-a6c3-00a08b063f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-816924416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54796eec-fde6-4fe3-828f-62c3f44e125a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af82dedc8c642eeb63d2eb33d9e2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:21Z,use_quota=True,user_id='c0e3eb1afb40418f828ab01060c86ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f358c2e7-0f91-4ea1-9360-c0eb5a877c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f358c2e7-0f91-4ea1-9360-c0eb5a877c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90323070-c556-4a80-9cf9-1d9056b20661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90323070-c556-4a80-9cf9-1d9056b20661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54796eec-fde6-4fe3-828f-62c3f44e125a', 'volume_name': 'volume-54796eec-fde6-4fe3-828f-62c3f44e125a', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6183eda-276c-4a07-8705-7b4b569f5132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6183eda-276c-4a07-8705-7b4b569f5132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc49b09-743b-4ea7-9a34-97c8862ab3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:21 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Volume 54796eec-fde6-4fe3-828f-62c3f44e125a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54796eec-fde6-4fe3-828f-62c3f44e125a', 'volume_size': 1}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-816924416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54796eec-fde6-4fe3-828f-62c3f44e125a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af82dedc8c642eeb63d2eb33d9e2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:21Z,use_quota=True,user_id='c0e3eb1afb40418f828ab01060c86ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Creating volume 54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:21 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:21 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a 1073741824
Nov 05 12:03:21 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:21 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a 1073741824" returned: 0 in 0.671s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:21 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a
Nov 05 12:03:21 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:22 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a" returned: 0 in 0.341s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:03:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc49b09-743b-4ea7-9a34-97c8862ab3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54796eec-fde6-4fe3-828f-62c3f44e125a', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692ce349-abad-4ce8-bd42-820d98e3807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:22 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Volume volume-54796eec-fde6-4fe3-828f-62c3f44e125a (54796eec-fde6-4fe3-828f-62c3f44e125a): created successfully
Nov 05 12:03:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692ce349-abad-4ce8-bd42-820d98e3807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Flow 'volume_create_manager' (3c149528-ea55-41dd-b5e6-26225032aa0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:22 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-eeb8b49e-fa81-447e-9350-23caedfe1149 tempest-SnapshotDependencyTests-237721649 None] Created volume successfully.
Nov 05 12:03:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Creating offline snapshot c7272919-e5d7-41cf-a00f-ffe38a644092 of volume 54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:03:23 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b510b-d54c-4c00-8a67-f7cb5ac6c02b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:23 devstack sudo[98223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a
Nov 05 12:03:23 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:24 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a" returned: 0 in 0.567s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:24 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 1G
Nov 05 12:03:24 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:24 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 1G" returned: 0 in 0.610s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54796eec-fde6-4fe3-828f-62c3f44e125a -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:24 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54796eec-fde6-4fe3-828f-62c3f44e125a -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092
Nov 05 12:03:24 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:25 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54796eec-fde6-4fe3-828f-62c3f44e125a -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092" returned: 0 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:25 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 is being set with open permissions: ugo+rw
Nov 05 12:03:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:25 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092
Nov 05 12:03:25 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:25 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092" returned: 0 in 0.340s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:25 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.info
Nov 05 12:03:25 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:25 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.info" returned: 0 in 0.362s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:25 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.info is being set with open permissions: ugo+rw
Nov 05 12:03:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:25 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.info
Nov 05 12:03:25 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:26 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.info" returned: 0 in 0.376s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:26 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-07635e1d-59fd-4c04-ad33-72f17ac687cb tempest-SnapshotDependencyTests-237721649 None] Create snapshot completed successfully
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Flow 'volume_create_manager' (6aa8ac76-ec86-45d6-8f3c-07855a854ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b09733-b608-458a-adb9-5f289229c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b09733-b608-458a-adb9-5f289229c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6499eec-5e61-4929-90f7-0645d93a2150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af82dedc8c642eeb63d2eb33d9e2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7272919-e5d7-41cf-a00f-ffe38a644092,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:03:27Z,use_quota=True,user_id='c0e3eb1afb40418f828ab01060c86ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b1b043-fdb0-4771-98c5-cf88edc2ecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b1b043-fdb0-4771-98c5-cf88edc2ecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5b7828-8378-4b77-a428-7923fc116f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5b7828-8378-4b77-a428-7923fc116f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6499eec-5e61-4929-90f7-0645d93a2150', 'volume_name': 'volume-f6499eec-5e61-4929-90f7-0645d93a2150', 'volume_size': 1, 'snapshot_id': 'c7272919-e5d7-41cf-a00f-ffe38a644092'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d359e2-8d80-45d0-8095-3c9abaeaf80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d359e2-8d80-45d0-8095-3c9abaeaf80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5221544-9105-4339-a2e6-62426b1e0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Volume f6499eec-5e61-4929-90f7-0645d93a2150: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6499eec-5e61-4929-90f7-0645d93a2150', 'volume_size': 1, 'snapshot_id': 'c7272919-e5d7-41cf-a00f-ffe38a644092'}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-quobyte-c7272919-e5d7-41cf-a00f-ffe38a644092-f6499eec-5e61-4929-90f7-0645d93a2150" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-c7272919-e5d7-41cf-a00f-ffe38a644092-f6499eec-5e61-4929-90f7-0645d93a2150" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Creating volume f6499eec-5e61-4929-90f7-0645d93a2150 from snapshot c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-quobyte-f6499eec-5e61-4929-90f7-0645d93a2150" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-f6499eec-5e61-4929-90f7-0645d93a2150" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] snapshot: c7272919-e5d7-41cf-a00f-ffe38a644092, volume: f6499eec-5e61-4929-90f7-0645d93a2150,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c446437-ea47-48c2-9813-8e53f82e231c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:27 devstack sudo[98249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092
Nov 05 12:03:27 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:28 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092" returned: 0 in 0.544s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54796eec-fde6-4fe3-828f-62c3f44e125a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a79992-587e-46ce-a7b1-7069df6f310f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:28 devstack sudo[98255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a
Nov 05 12:03:28 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:28 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a" returned: 0 in 0.627s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:03:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:28 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150
Nov 05 12:03:28 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:37 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:03:37 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10,cinder:INSERT=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:03:39 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150" returned: 0 in 10.149s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a, size 1024.00 MB, duration 10.15 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:03:39 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Converted 1024.00 MB image at 100.89 MB/s
Nov 05 12:03:39 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150 is being set with open permissions: ugo+rw
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:39 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150
Nov 05 12:03:39 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:39 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150" returned: 0 in 0.306s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-f6499eec-5e61-4929-90f7-0645d93a2150" released by "_copy_volume_from_snapshot" :: held 11.784s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-c7272919-e5d7-41cf-a00f-ffe38a644092-f6499eec-5e61-4929-90f7-0645d93a2150" released by "_create_volume_from_snapshot" :: held 11.874s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.896s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5221544-9105-4339-a2e6-62426b1e0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6499eec-5e61-4929-90f7-0645d93a2150', 'volume_size': 1, 'snapshot_id': 'c7272919-e5d7-41cf-a00f-ffe38a644092'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51a7cf-b4eb-4105-b344-c80b65561e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:03:39 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Volume volume-f6499eec-5e61-4929-90f7-0645d93a2150 (f6499eec-5e61-4929-90f7-0645d93a2150): created successfully
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51a7cf-b4eb-4105-b344-c80b65561e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:03:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Flow 'volume_create_manager' (6aa8ac76-ec86-45d6-8f3c-07855a854ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:03:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8246f922-8f99-4c43-95d1-da8c8c6fc158 tempest-SnapshotDependencyTests-237721649 None] Created volume successfully.
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-c7272919-e5d7-41cf-a00f-ffe38a644092-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-c7272919-e5d7-41cf-a00f-ffe38a644092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-quobyte-54796eec-fde6-4fe3-828f-62c3f44e125a" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-54796eec-fde6-4fe3-828f-62c3f44e125a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-quobyte-c7272919-e5d7-41cf-a00f-ffe38a644092" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-c7272919-e5d7-41cf-a00f-ffe38a644092" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Deleting offline snapshot c7272919-e5d7-41cf-a00f-ffe38a644092 of volume 54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] snapshot_file for this snap is: volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[510742c6-0c4f-4f59-b875-eb122b878f3a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:40 devstack sudo[98298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092
Nov 05 12:03:40 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:40 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092" returned: 0 in 0.560s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54796eec-fde6-4fe3-828f-62c3f44e125a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[11468b50-67d9-4e6c-b414-b53a1c70a881]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:41 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a
Nov 05 12:03:41 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:41 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a" returned: 0 in 0.811s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:41 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092
Nov 05 12:03:41 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:42 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092" returned: 0 in 0.467s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:42 devstack sudo[98315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092
Nov 05 12:03:42 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:42 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a.c7272919-e5d7-41cf-a00f-ffe38a644092" returned: 0 in 0.344s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-c7272919-e5d7-41cf-a00f-ffe38a644092" released by "_delete_snapshot" :: held 2.363s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-54796eec-fde6-4fe3-828f-62c3f44e125a" released by "delete_snapshot" :: held 2.392s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:42 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Created reservations ['f9169c0f-d789-4f27-9da9-fab7b82a06ff', '80dc89cc-df94-4695-baf8-e6f4698c29f7', '899fa267-6ae2-474d-ba52-82ae437e1f9e', '894293e9-c99a-4997-b81d-708777e0996f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Delete snapshot completed successfully.
Nov 05 12:03:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-12e48cf8-3eb0-40a9-a6b3-fe13f44bb371 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-c7272919-e5d7-41cf-a00f-ffe38a644092-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-54796eec-fde6-4fe3-828f-62c3f44e125a-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-54796eec-fde6-4fe3-828f-62c3f44e125a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-quobyte-54796eec-fde6-4fe3-828f-62c3f44e125a" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-54796eec-fde6-4fe3-828f-62c3f44e125a" acquired by "delete_volume" :: waited 0.050s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac0d7e-8575-4ea7-98d9-8f63e7c6da1a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:43 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a
Nov 05 12:03:43 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:44 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a" returned: 0 in 0.628s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:44 devstack sudo[98388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a
Nov 05 12:03:44 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:44 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54796eec-fde6-4fe3-828f-62c3f44e125a" returned: 0 in 0.468s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-54796eec-fde6-4fe3-828f-62c3f44e125a" released by "delete_volume" :: held 1.299s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Created reservations ['2c37ac8c-4f93-4944-ae21-ab1cd2a1ffd6', 'd9058693-6c27-4a81-8236-12cccd10ff66', '37b03025-269b-4ecb-a191-4dac17acecf4', '10f5080e-f31a-4d6d-bca6-65d60aa5f037'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:45 devstack sudo[98393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:03:45 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:45 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.359s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Deleted volume successfully.
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0942c4b-2074-435b-a737-b2c4f176c457 tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-54796eec-fde6-4fe3-828f-62c3f44e125a-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-f6499eec-5e61-4929-90f7-0645d93a2150-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-f6499eec-5e61-4929-90f7-0645d93a2150-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "cinder-quobyte-f6499eec-5e61-4929-90f7-0645d93a2150" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-f6499eec-5e61-4929-90f7-0645d93a2150" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[27211592-ec1a-4887-9f61-1a4288cc9b03]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:46 devstack sudo[98396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150
Nov 05 12:03:46 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:46 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150" returned: 0 in 0.515s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:46 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150
Nov 05 12:03:46 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:46 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6499eec-5e61-4929-90f7-0645d93a2150" returned: 0 in 0.340s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-quobyte-f6499eec-5e61-4929-90f7-0645d93a2150" released by "delete_volume" :: held 0.943s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Created reservations ['c6b53015-3faa-4843-bdc6-82e736ce3d8f', 'b814bb1d-2438-4577-aebf-45c615a47f4e', 'cfc386bc-a0cd-45cf-a0c3-041200b6ac0e', '960fe7a0-011f-4f32-850e-51fa26c0aea6'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:03:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:03:47 devstack sudo[98407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:03:47 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:03:48 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root
Nov 05 12:03:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.653s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:03:48 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:03:48 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Deleted volume successfully.
Nov 05 12:03:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fe51732-4a68-4bfe-a3b5-52a048032d5c tempest-SnapshotDependencyTests-237721649 None] Lock "cinder-f6499eec-5e61-4929-90f7-0645d93a2150-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:03:57 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:03:58 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2,cinder:SELECT=16 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Flow 'volume_create_manager' (27d868fc-cd4a-408d-a2eb-4ac410e8555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d089d0b-878a-4d89-95a7-436c3d14586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d089d0b-878a-4d89-95a7-436c3d14586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1043759365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3690ccdc-82e8-48bb-8c07-59b5e149191e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd455dabeecc4ccfb96b9c3f60240362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:05Z,use_quota=True,user_id='2486886a43c8486a9548a7f2e76cae89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb951cc-9544-4755-b941-18b586b7b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb951cc-9544-4755-b941-18b586b7b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3e9f78-6d92-485d-8f40-7528bad1ad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Flow 'volume_create_manager' (e3f2eb50-79a1-4df3-9902-b3d0ade8dbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af55a98-fa1c-4bc9-b9b8-3a2137a8b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af55a98-fa1c-4bc9-b9b8-3a2137a8b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1614572596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c2c233-000b-40ad-92ca-197ffa31089f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a964791777a4b98985c438793d94c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:06Z,use_quota=True,user_id='657a3c3a695748bab4c5834b9b13cb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c34b21d-ec77-43fd-a7b2-2d5e043d8edb),volume_type_id=0c34b21d-ec77-43fd-a7b2-2d5e043d8edb)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326c98c3-e6ce-486a-bdc5-a1b1ec652b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326c98c3-e6ce-486a-bdc5-a1b1ec652b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbc4833-7590-4c81-9464-be9b9a3a25dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbc4833-7590-4c81-9464-be9b9a3a25dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c2c233-000b-40ad-92ca-197ffa31089f', 'volume_name': 'volume-11c2c233-000b-40ad-92ca-197ffa31089f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7d7907-3a57-49af-a6fc-90aaf4320447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7d7907-3a57-49af-a6fc-90aaf4320447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6caf04d8-6909-4453-aa83-d2bdd20eb8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:05 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Volume 11c2c233-000b-40ad-92ca-197ffa31089f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c2c233-000b-40ad-92ca-197ffa31089f', 'volume_size': 1}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1614572596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c2c233-000b-40ad-92ca-197ffa31089f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a964791777a4b98985c438793d94c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:06Z,use_quota=True,user_id='657a3c3a695748bab4c5834b9b13cb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c34b21d-ec77-43fd-a7b2-2d5e043d8edb),volume_type_id=0c34b21d-ec77-43fd-a7b2-2d5e043d8edb)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Creating volume 11c2c233-000b-40ad-92ca-197ffa31089f {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:05 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:04:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:05 devstack sudo[98505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f 1073741824
Nov 05 12:04:05 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3e9f78-6d92-485d-8f40-7528bad1ad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3690ccdc-82e8-48bb-8c07-59b5e149191e', 'volume_name': 'volume-3690ccdc-82e8-48bb-8c07-59b5e149191e', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0294ac980>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b08797-e45f-468c-a7dd-63bf55d79bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b08797-e45f-468c-a7dd-63bf55d79bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c8624c-3b78-4d12-acef-e438e8d35f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Volume 3690ccdc-82e8-48bb-8c07-59b5e149191e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3690ccdc-82e8-48bb-8c07-59b5e149191e', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0294ac980>}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Trying to clone 3690ccdc-82e8-48bb-8c07-59b5e149191e from image 71120f13-1140-4938-836f-6085e103efeb at location (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:04:06 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f 1073741824" returned: 0 in 0.558s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:06 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f
Nov 05 12:04:06 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:04:06 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd45712a-8628-4659-8a9b-fa4987e6b2a2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:06 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD
Nov 05 12:04:06 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:06 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f" returned: 0 in 0.288s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6caf04d8-6909-4453-aa83-d2bdd20eb8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c2c233-000b-40ad-92ca-197ffa31089f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aa85c1-8d27-45d5-bde9-00baf70efd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Volume volume-11c2c233-000b-40ad-92ca-197ffa31089f (11c2c233-000b-40ad-92ca-197ffa31089f): created successfully
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aa85c1-8d27-45d5-bde9-00baf70efd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Flow 'volume_create_manager' (e3f2eb50-79a1-4df3-9902-b3d0ade8dbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e2f53131-66e9-4ea6-9d9f-5ed8bae1e047 tempest-VolumeTypesAccessTest-1954652613 None] Created volume successfully.
Nov 05 12:04:07 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb is fetched for user 2486886a43c8486a9548a7f2e76cae89. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e3ab77-8525-4aa9-b769-485fa0d55e4d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:07 devstack sudo[98520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD
Nov 05 12:04:07 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:07 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1043759365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3690ccdc-82e8-48bb-8c07-59b5e149191e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd455dabeecc4ccfb96b9c3f60240362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:05Z,use_quota=True,user_id='2486886a43c8486a9548a7f2e76cae89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Creating volume 3690ccdc-82e8-48bb-8c07-59b5e149191e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:07 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:07 devstack sudo[98526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e 1073741824
Nov 05 12:04:07 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Acquiring lock "cinder-11c2c233-000b-40ad-92ca-197ffa31089f-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Lock "cinder-11c2c233-000b-40ad-92ca-197ffa31089f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Acquiring lock "cinder-quobyte-11c2c233-000b-40ad-92ca-197ffa31089f" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Lock "cinder-quobyte-11c2c233-000b-40ad-92ca-197ffa31089f" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6525540-ff43-445a-a3e1-e6a058d80351]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:08 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f
Nov 05 12:04:08 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:08 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e 1073741824" returned: 0 in 0.857s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:08 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e
Nov 05 12:04:08 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:08 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f" returned: 0 in 0.609s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:08 devstack sudo[98540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f
Nov 05 12:04:08 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:08 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e" returned: 0 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Attempting download of 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume 3690ccdc-82e8-48bb-8c07-59b5e149191e. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[978963d0-a583-4381-9814-11d3568c3c91]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_pug2hidb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:08 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-11c2c233-000b-40ad-92ca-197ffa31089f" returned: 0 in 0.355s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Lock "cinder-quobyte-11c2c233-000b-40ad-92ca-197ffa31089f" released by "delete_volume" :: held 1.041s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:09 devstack cinder-volume[87317]: WARNING cinder.quota [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1441377418 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1441377418, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:04:09 devstack cinder-volume[87317]: WARNING cinder.quota [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1441377418 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1441377418, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Created reservations ['cd34c806-c1ee-4c4a-9751-3bf79bc3860d', '31ee6724-43c3-4964-acea-8eb0e468a02e', 'edf31c13-382e-49a6-8602-5daba21a7933', '3e84edac-7653-4fd6-950f-c6401b95c8bc'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:09 devstack sudo[98544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_pug2hidb
Nov 05 12:04:09 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:09 devstack sudo[98546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:04:09 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:09 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_pug2hidb" returned: 0 in 0.445s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_pug2hidb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:09 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.330s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:09 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Deleted volume successfully.
Nov 05 12:04:09 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_pug2hidb
Nov 05 12:04:09 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-568e20ad-c0d4-40e2-ac41-8583fe0e2a79 tempest-VolumeTypesAccessTest-1954652613 None] Lock "cinder-11c2c233-000b-40ad-92ca-197ffa31089f-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:09 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_pug2hidb" returned: 1 in 0.428s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_pug2hidb' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b76d0c-f74c-4d63-8b0e-c8050f15a067]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:09 devstack sudo[98555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD
Nov 05 12:04:09 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:10 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:10 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] 71120f13-1140-4938-836f-6085e103efeb was qcow2, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:04:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:10 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e
Nov 05 12:04:10 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Flow 'volume_create_manager' (1c05c5ce-38de-4c10-913b-14e6d6967282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a71802-3c52-4ef1-8cf2-aa957e19c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a71802-3c52-4ef1-8cf2-aa957e19c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1676434912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd6123c-d7c1-46ad-b99b-531a284f8ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9333fb17713a4ed4903b4400dc48a277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:12Z,use_quota=True,user_id='c5bf6cfb10314627905b4ebef15be500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e451b547-b1a1-4d0d-aa86-27b294180f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e451b547-b1a1-4d0d-aa86-27b294180f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4b5732-eacf-4287-a27e-82e278d564f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4b5732-eacf-4287-a27e-82e278d564f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd6123c-d7c1-46ad-b99b-531a284f8ce0', 'volume_name': 'volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622446b7-d5ac-406b-85ff-03fd13fec60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622446b7-d5ac-406b-85ff-03fd13fec60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d9ff34-4642-46ee-a6a4-4c1b669f094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:11 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Volume 8bd6123c-d7c1-46ad-b99b-531a284f8ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0', 'volume_size': 1}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1676434912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd6123c-d7c1-46ad-b99b-531a284f8ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9333fb17713a4ed4903b4400dc48a277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:12Z,use_quota=True,user_id='c5bf6cfb10314627905b4ebef15be500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Creating volume 8bd6123c-d7c1-46ad-b99b-531a284f8ce0 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:11 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:04:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:11 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0 1073741824
Nov 05 12:04:11 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:12 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0 1073741824" returned: 0 in 0.581s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:12 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0
Nov 05 12:04:12 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:12 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e" returned: 0 in 2.436s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_hlj91dn3devstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:04:12 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Converted 112.00 MB image at 45.93 MB/s
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:12 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e 1G
Nov 05 12:04:12 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:12 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0" returned: 0 in 0.291s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d9ff34-4642-46ee-a6a4-4c1b669f094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09df4c31-a079-4c96-9237-604141f919f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:12 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Volume volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0 (8bd6123c-d7c1-46ad-b99b-531a284f8ce0): created successfully
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09df4c31-a079-4c96-9237-604141f919f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Flow 'volume_create_manager' (1c05c5ce-38de-4c10-913b-14e6d6967282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:12 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-81c1a14b-577b-4b69-bded-7460baa5a300 tempest-AttachVolumeTestJSON-790998958 None] Created volume successfully.
Nov 05 12:04:12 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e 1G" returned: 0 in 0.376s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Downloaded image 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume 3690ccdc-82e8-48bb-8c07-59b5e149191e successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb for user 2486886a43c8486a9548a7f2e76cae89 is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:04:12 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Marking volume 3690ccdc-82e8-48bb-8c07-59b5e149191e as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Copying metadata from image 71120f13-1140-4938-836f-6085e103efeb to 3690ccdc-82e8-48bb-8c07-59b5e149191e. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Creating volume glance metadata for volume 3690ccdc-82e8-48bb-8c07-59b5e149191e backed by image 71120f13-1140-4938-836f-6085e103efeb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c8624c-3b78-4d12-acef-e438e8d35f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3690ccdc-82e8-48bb-8c07-59b5e149191e', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd0294ac980>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da61afc6-9f87-4a30-a169-abdf7568ca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:13 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Volume volume-3690ccdc-82e8-48bb-8c07-59b5e149191e (3690ccdc-82e8-48bb-8c07-59b5e149191e): created successfully
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da61afc6-9f87-4a30-a169-abdf7568ca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Flow 'volume_create_manager' (27d868fc-cd4a-408d-a2eb-4ac410e8555c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:13 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-537bd7b7-75cc-4543-b6e8-adb512a4f619 tempest-TestShelveInstance-1369336254 None] Created volume successfully.
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:13 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:04:13 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:13 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.325s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:04:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:04:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-6abceadc-3af7-4e3a-8c7a-88f6310973ff req-e328b0d4-d02d-46df-81d2-9d9a7b0b2ad3 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-6abceadc-3af7-4e3a-8c7a-88f6310973ff req-e328b0d4-d02d-46df-81d2-9d9a7b0b2ad3 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-6abceadc-3af7-4e3a-8c7a-88f6310973ff req-e328b0d4-d02d-46df-81d2-9d9a7b0b2ad3 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-6abceadc-3af7-4e3a-8c7a-88f6310973ff req-e328b0d4-d02d-46df-81d2-9d9a7b0b2ad3 tempest-AttachVolumeTestJSON-790998958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5598d317-296e-4132-8bac-98b2161680a8', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:04:14 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-6abceadc-3af7-4e3a-8c7a-88f6310973ff req-e328b0d4-d02d-46df-81d2-9d9a7b0b2ad3 tempest-AttachVolumeTestJSON-790998958 None] attachment_update completed successfully.
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-65f0fc91-8727-42f9-a8ab-c4b8bab2d402 req-17af52b1-cf80-4066-aa70-2cc6f3966306 tempest-TestShelveInstance-1369336254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-65f0fc91-8727-42f9-a8ab-c4b8bab2d402 req-17af52b1-cf80-4066-aa70-2cc6f3966306 tempest-TestShelveInstance-1369336254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-65f0fc91-8727-42f9-a8ab-c4b8bab2d402 req-17af52b1-cf80-4066-aa70-2cc6f3966306 tempest-TestShelveInstance-1369336254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-65f0fc91-8727-42f9-a8ab-c4b8bab2d402 req-17af52b1-cf80-4066-aa70-2cc6f3966306 tempest-TestShelveInstance-1369336254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-3690ccdc-82e8-48bb-8c07-59b5e149191e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f11190e4-0ddc-45e9-a1aa-b4b42ce5c27a', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:04:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-65f0fc91-8727-42f9-a8ab-c4b8bab2d402 req-17af52b1-cf80-4066-aa70-2cc6f3966306 tempest-TestShelveInstance-1369336254 None] attachment_update completed successfully.
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Flow 'volume_create_manager' (42c695c4-b0d1-418d-aea7-a3ee3505e799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690129ae-bc06-4c35-b66c-35db44703ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690129ae-bc06-4c35-b66c-35db44703ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-533596996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad0b368-068f-4b06-a0dc-d45be5efcd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9333fb17713a4ed4903b4400dc48a277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:18Z,use_quota=True,user_id='c5bf6cfb10314627905b4ebef15be500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b70aa5f-1346-4135-b11e-ef6284b0b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b70aa5f-1346-4135-b11e-ef6284b0b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a075ef9-9273-4dca-81e1-c41b16d10aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a075ef9-9273-4dca-81e1-c41b16d10aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad0b368-068f-4b06-a0dc-d45be5efcd50', 'volume_name': 'volume-fad0b368-068f-4b06-a0dc-d45be5efcd50', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53d1f85-5795-4a7f-932b-03130a78da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53d1f85-5795-4a7f-932b-03130a78da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60bbbe9-1fff-484a-8a96-4d4978f2df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:17 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Volume fad0b368-068f-4b06-a0dc-d45be5efcd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad0b368-068f-4b06-a0dc-d45be5efcd50', 'volume_size': 1}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-533596996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad0b368-068f-4b06-a0dc-d45be5efcd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9333fb17713a4ed4903b4400dc48a277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:18Z,use_quota=True,user_id='c5bf6cfb10314627905b4ebef15be500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Creating volume fad0b368-068f-4b06-a0dc-d45be5efcd50 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:17 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:04:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:17 devstack sudo[99033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50 1073741824
Nov 05 12:04:17 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:18 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50 1073741824" returned: 0 in 0.692s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:18 devstack sudo[99039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50
Nov 05 12:04:18 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:18 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50" returned: 0 in 0.318s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60bbbe9-1fff-484a-8a96-4d4978f2df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad0b368-068f-4b06-a0dc-d45be5efcd50', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327e9a3b-a56d-49a6-a05c-e0fdbb15d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:18 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Volume volume-fad0b368-068f-4b06-a0dc-d45be5efcd50 (fad0b368-068f-4b06-a0dc-d45be5efcd50): created successfully
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327e9a3b-a56d-49a6-a05c-e0fdbb15d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Flow 'volume_create_manager' (42c695c4-b0d1-418d-aea7-a3ee3505e799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c329c166-b752-4d95-97d7-0a5177b31f8e tempest-AttachVolumeTestJSON-790998958 None] Created volume successfully.
Nov 05 12:04:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-532f4115-867a-46f3-b56d-970e5fca944f req-b092a12f-26b9-465d-98d0-bae01ef9250c tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-532f4115-867a-46f3-b56d-970e5fca944f req-b092a12f-26b9-465d-98d0-bae01ef9250c tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-532f4115-867a-46f3-b56d-970e5fca944f req-b092a12f-26b9-465d-98d0-bae01ef9250c tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-532f4115-867a-46f3-b56d-970e5fca944f req-b092a12f-26b9-465d-98d0-bae01ef9250c tempest-AttachVolumeTestJSON-790998958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-fad0b368-068f-4b06-a0dc-d45be5efcd50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d42d95c-0975-4062-86af-bd18ed3ff748', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:04:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-532f4115-867a-46f3-b56d-970e5fca944f req-b092a12f-26b9-465d-98d0-bae01ef9250c tempest-AttachVolumeTestJSON-790998958 None] attachment_update completed successfully.
Nov 05 12:04:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-6053a5a8-702c-4d15-9ce5-d8c9c3cf5163 req-d93bdb8d-296a-4760-aed3-ceb830e98de6 tempest-AttachVolumeTestJSON-790998958 None] Terminate volume connection completed successfully.
Nov 05 12:04:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-6053a5a8-702c-4d15-9ce5-d8c9c3cf5163 req-d93bdb8d-296a-4760-aed3-ceb830e98de6 tempest-AttachVolumeTestJSON-790998958 None] Deleting attachment 5598d317-296e-4132-8bac-98b2161680a8. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:04:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-e8b36313-fd73-4a8f-8b60-34dd907cfd40 req-245790d7-dcee-4d3f-a918-41edff2beaa6 tempest-AttachVolumeTestJSON-790998958 None] Terminate volume connection completed successfully.
Nov 05 12:04:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-e8b36313-fd73-4a8f-8b60-34dd907cfd40 req-245790d7-dcee-4d3f-a918-41edff2beaa6 tempest-AttachVolumeTestJSON-790998958 None] Deleting attachment 1d42d95c-0975-4062-86af-bd18ed3ff748. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:04:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "cinder-fad0b368-068f-4b06-a0dc-d45be5efcd50-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-fad0b368-068f-4b06-a0dc-d45be5efcd50-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "cinder-quobyte-fad0b368-068f-4b06-a0dc-d45be5efcd50" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-quobyte-fad0b368-068f-4b06-a0dc-d45be5efcd50" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8945cd48-8315-4f3b-851a-906208db181b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:35 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50
Nov 05 12:04:35 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:35 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50" returned: 0 in 0.509s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:35 devstack sudo[99190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50
Nov 05 12:04:35 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:35 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fad0b368-068f-4b06-a0dc-d45be5efcd50" returned: 0 in 0.302s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-quobyte-fad0b368-068f-4b06-a0dc-d45be5efcd50" released by "delete_volume" :: held 0.873s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:35 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Created reservations ['fcc71af0-2721-401a-b6c8-4b7517769821', '53efe652-32a9-4b57-86df-493837427a34', '87da2d4c-baa2-4fef-a300-9605b0ef0fa7', 'd29a624b-9f05-4397-ac4f-14cdbb92b044'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:36 devstack sudo[99193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:04:36 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "cinder-8bd6123c-d7c1-46ad-b99b-531a284f8ce0-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-8bd6123c-d7c1-46ad-b99b-531a284f8ce0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "cinder-quobyte-8bd6123c-d7c1-46ad-b99b-531a284f8ce0" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-quobyte-8bd6123c-d7c1-46ad-b99b-531a284f8ce0" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf4ba1c-8f9f-4a2d-87fc-d36b6e9f54c1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:36 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.370s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:36 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Deleted volume successfully.
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e1f84874-f24e-465a-83a9-d6ff26809fbd tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-fad0b368-068f-4b06-a0dc-d45be5efcd50-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:36 devstack sudo[99195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0
Nov 05 12:04:36 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:36 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0" returned: 0 in 0.541s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:36 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0
Nov 05 12:04:36 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:37 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8bd6123c-d7c1-46ad-b99b-531a284f8ce0" returned: 0 in 0.323s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-quobyte-8bd6123c-d7c1-46ad-b99b-531a284f8ce0" released by "delete_volume" :: held 0.935s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Created reservations ['882daf34-8120-481e-9306-eaab0976375d', '860b8e21-4e59-4eb8-a6be-ee051d39de4e', 'bcc49761-4ade-424d-a9bd-a0d6f9d3c09f', 'cbd8ed23-c176-4750-9e4b-3142b4c77657'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:37 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:04:37 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:37 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Deleted volume successfully.
Nov 05 12:04:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9e7b8703-74cc-4022-9a04-c24063fde715 tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-8bd6123c-d7c1-46ad-b99b-531a284f8ce0-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "cinder-444f98e9-0c14-4586-a2b7-383299306b44-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-444f98e9-0c14-4586-a2b7-383299306b44-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "cinder-quobyte-444f98e9-0c14-4586-a2b7-383299306b44" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:04:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-quobyte-444f98e9-0c14-4586-a2b7-383299306b44" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:04:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[61294428-cf41-4208-85b8-c5d69adebbe3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:38 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44
Nov 05 12:04:38 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:39 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44" returned: 0 in 0.408s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:39 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44
Nov 05 12:04:39 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:39 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-444f98e9-0c14-4586-a2b7-383299306b44" returned: 0 in 0.338s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-quobyte-444f98e9-0c14-4586-a2b7-383299306b44" released by "delete_volume" :: held 0.833s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Created reservations ['de6e5d3b-4f97-4d31-bced-3df2ca9cc012', '7afed3e7-92be-42a0-80a2-b20c20e8e8f5', 'e3b29f27-be40-41f7-9307-696ab5eb9ca4', '281ec36a-136c-4277-ae1b-c1a8b62aab58'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:39 devstack sudo[99215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:04:39 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:40 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:40 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:04:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Deleted volume successfully.
Nov 05 12:04:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e1202dd-5b6d-4e3d-a51d-cb71bf4aa59a tempest-AttachVolumeTestJSON-790998958 None] Lock "cinder-444f98e9-0c14-4586-a2b7-383299306b44-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:04:49 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=65,cinder:UPDATE=46,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:04:50 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=54,cinder:SELECT=49,cinder:DELETE=2,cinder:INSERT=15 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:04:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bb039e32-7e6d-4b1a-bd14-5d4343d6b5a0 tempest-GroupSnapshotsTest-11402096 None] Group tempest-GroupSnapshotsTest-Group-1660721482: creating
Nov 05 12:04:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bb039e32-7e6d-4b1a-bd14-5d4343d6b5a0 tempest-GroupSnapshotsTest-11402096 None] Group tempest-GroupSnapshotsTest-Group-1660721482: created successfully
Nov 05 12:04:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bb039e32-7e6d-4b1a-bd14-5d4343d6b5a0 tempest-GroupSnapshotsTest-11402096 None] Create group completed successfully.
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (3864a2b6-77eb-408c-8ce1-aa604352a93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ff204f-5030-4362-9d6e-44bff002e159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ff204f-5030-4362-9d6e-44bff002e159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-277924903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=71a4fcd2-e0a0-41e8-8888-27250e0e3565,host='devstack@QuobyteHD#QuobyteHD',id=a01d19a7-a6f1-4213-bd4d-d70c3aa26196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:54Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9853fc8b-f4cf-47e8-946b-47bbc33a05f9),volume_type_id=9853fc8b-f4cf-47e8-946b-47bbc33a05f9)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9013463-7ef5-47f8-bc45-cd2f1c783215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9013463-7ef5-47f8-bc45-cd2f1c783215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dd8e02-6406-4336-bdc4-306ec2f695f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dd8e02-6406-4336-bdc4-306ec2f695f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01d19a7-a6f1-4213-bd4d-d70c3aa26196', 'volume_name': 'volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7a3f03-a7ab-466b-9900-b4010cd20b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7a3f03-a7ab-466b-9900-b4010cd20b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f3af1a-b3f2-47d6-89dd-561dfb4bc98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Volume a01d19a7-a6f1-4213-bd4d-d70c3aa26196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196', 'volume_size': 1}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=71a4fcd2-e0a0-41e8-8888-27250e0e3565,created_at=2026-11-05T11:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-277924903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=71a4fcd2-e0a0-41e8-8888-27250e0e3565,host='devstack@QuobyteHD#QuobyteHD',id=a01d19a7-a6f1-4213-bd4d-d70c3aa26196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:54Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9853fc8b-f4cf-47e8-946b-47bbc33a05f9),volume_type_id=9853fc8b-f4cf-47e8-946b-47bbc33a05f9)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Creating volume a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:04:54 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:04:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:54 devstack sudo[99274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 1073741824
Nov 05 12:04:54 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:55 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 1073741824" returned: 0 in 1.040s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:55 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196
Nov 05 12:04:55 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:55 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" returned: 0 in 0.497s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f3af1a-b3f2-47d6-89dd-561dfb4bc98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1317fa-840c-486a-8bcc-32805725415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Volume volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 (a01d19a7-a6f1-4213-bd4d-d70c3aa26196): created successfully
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1317fa-840c-486a-8bcc-32805725415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (3864a2b6-77eb-408c-8ce1-aa604352a93b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-639557d1-6e82-481f-8598-225e0ae39b31 tempest-GroupSnapshotsTest-11402096 None] Created volume successfully.
Nov 05 12:04:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-0c75a9c3-7371-446e-a9a8-f84c12139e50 req-3bb98ba1-b13c-4cdc-82b8-0f6886d0dd70 tempest-TestShelveInstance-1369336254 None] Terminate volume connection completed successfully.
Nov 05 12:04:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-0c75a9c3-7371-446e-a9a8-f84c12139e50 req-3bb98ba1-b13c-4cdc-82b8-0f6886d0dd70 tempest-TestShelveInstance-1369336254 None] Deleting attachment f11190e4-0ddc-45e9-a1aa-b4b42ce5c27a. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:04:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] GroupSnapshot 3ff05ed4-3700-4437-94bf-f1373772763a: creating.
Nov 05 12:04:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Group snapshot 3ff05ed4-3700-4437-94bf-f1373772763a: creating. {{(pid=87317) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 12:04:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:04:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Creating offline snapshot 43112fd3-c1c9-41d8-969d-67d140f1a76b of volume a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:04:57 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5098ab-195a-4edf-b638-8d35c3b3cf1d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:04:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:57 devstack sudo[99376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196
Nov 05 12:04:57 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:58 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" returned: 0 in 0.839s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:58 devstack sudo[99381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b 1G
Nov 05 12:04:58 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (4ec31933-14c0-4b42-8e35-0aa3e87ecb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d517d-c39b-44cf-8741-ad929157dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d517d-c39b-44cf-8741-ad929157dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-274894364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f492dc-f8cc-44dd-bb38-84615e225269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:59Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9acfa09-82b0-45dd-abd5-808b208b7a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9acfa09-82b0-45dd-abd5-808b208b7a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a89c28-a262-4fa1-811e-35ed2ce13888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a89c28-a262-4fa1-811e-35ed2ce13888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f492dc-f8cc-44dd-bb38-84615e225269', 'volume_name': 'volume-30f492dc-f8cc-44dd-bb38-84615e225269', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb371de-808c-4d75-88c8-33fd3405cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb371de-808c-4d75-88c8-33fd3405cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412591b9-9203-4981-a407-bf0f4bdafc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:04:59 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Volume 30f492dc-f8cc-44dd-bb38-84615e225269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f492dc-f8cc-44dd-bb38-84615e225269', 'volume_size': 1}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:04:59 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b 1G" returned: 0 in 0.883s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:59 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b
Nov 05 12:04:59 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:04:59 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b" returned: 0 in 0.480s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:04:59 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:04:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:04:59 devstack sudo[99395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b
Nov 05 12:04:59 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:00 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b" returned: 0 in 0.356s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:00 devstack sudo[99398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.info
Nov 05 12:05:00 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:00 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.info" returned: 0 in 0.332s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:00 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:00 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.info
Nov 05 12:05:00 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:01 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.info" returned: 0 in 0.491s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.529s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-274894364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f492dc-f8cc-44dd-bb38-84615e225269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:04:59Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Creating volume 30f492dc-f8cc-44dd-bb38-84615e225269 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:01 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:01 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269 1073741824
Nov 05 12:05:01 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-88090758-c75d-4915-b1ee-8fe0bf7ccb3d req-176da422-06d7-4050-a51b-b0a1a0a52b66 tempest-TestShelveInstance-1369336254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7278d460-59f6-4580-b2cb-7a21e33e0f66 tempest-GroupSnapshotsTest-11402096 None] group_snapshot 3ff05ed4-3700-4437-94bf-f1373772763a: created successfully
Nov 05 12:05:01 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269 1073741824" returned: 0 in 0.641s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:01 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269
Nov 05 12:05:01 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:02 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269" returned: 0 in 0.349s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-88090758-c75d-4915-b1ee-8fe0bf7ccb3d req-176da422-06d7-4050-a51b-b0a1a0a52b66 tempest-TestShelveInstance-1369336254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412591b9-9203-4981-a407-bf0f4bdafc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f492dc-f8cc-44dd-bb38-84615e225269', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fcf25a-96a3-4dfd-b6f6-832d0fbc648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-88090758-c75d-4915-b1ee-8fe0bf7ccb3d req-176da422-06d7-4050-a51b-b0a1a0a52b66 tempest-TestShelveInstance-1369336254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:02 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Volume volume-30f492dc-f8cc-44dd-bb38-84615e225269 (30f492dc-f8cc-44dd-bb38-84615e225269): created successfully
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fcf25a-96a3-4dfd-b6f6-832d0fbc648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (4ec31933-14c0-4b42-8e35-0aa3e87ecb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8967d512-45ed-4649-87c2-370e127faee2 tempest-VolumesActionsTest-2127965474 None] Created volume successfully.
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-88090758-c75d-4915-b1ee-8fe0bf7ccb3d req-176da422-06d7-4050-a51b-b0a1a0a52b66 tempest-TestShelveInstance-1369336254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-3690ccdc-82e8-48bb-8c07-59b5e149191e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebfd5842-1a31-4454-bc2d-e06e34ea1088', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:05:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-88090758-c75d-4915-b1ee-8fe0bf7ccb3d req-176da422-06d7-4050-a51b-b0a1a0a52b66 tempest-TestShelveInstance-1369336254 None] attachment_update completed successfully.
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c2291853-2a5a-4ff8-83bf-97d6b2309e4a tempest-VolumesActionsTest-2127965474 None] Acquiring lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269" by "attach_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c2291853-2a5a-4ff8-83bf-97d6b2309e4a tempest-VolumesActionsTest-2127965474 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269" acquired by "attach_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c2291853-2a5a-4ff8-83bf-97d6b2309e4a tempest-VolumesActionsTest-2127965474 None] Attaching volume 30f492dc-f8cc-44dd-bb38-84615e225269 to instance 7643934d-e419-4a49-a497-0eb1c2a3681f at mountpoint /dev/vdb on host None.
Nov 05 12:05:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c2291853-2a5a-4ff8-83bf-97d6b2309e4a tempest-VolumesActionsTest-2127965474 None] Attach volume completed successfully.
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c2291853-2a5a-4ff8-83bf-97d6b2309e4a tempest-VolumesActionsTest-2127965474 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269" released by "attach_volume" :: held 0.152s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-43112fd3-c1c9-41d8-969d-67d140f1a76b-c1e23440-785f-4c6d-877e-bee6873940ba" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-43112fd3-c1c9-41d8-969d-67d140f1a76b-c1e23440-785f-4c6d-877e-bee6873940ba" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Creating volume c1e23440-785f-4c6d-877e-bee6873940ba from snapshot 43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-c1e23440-785f-4c6d-877e-bee6873940ba" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-c1e23440-785f-4c6d-877e-bee6873940ba" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] snapshot: 43112fd3-c1c9-41d8-969d-67d140f1a76b, volume: c1e23440-785f-4c6d-877e-bee6873940ba,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db01ca3-0f77-476e-b968-826aabfcc665]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:03 devstack sudo[99426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b
Nov 05 12:05:03 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:03 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b" returned: 0 in 0.687s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6da62ba-7b60-4188-bb29-1ec68e3ced9a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-059aea5d-63df-4cac-8fac-523dba7cdd9d tempest-VolumesActionsTest-455952201 None] Terminate volume connection completed successfully.
Nov 05 12:05:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-059aea5d-63df-4cac-8fac-523dba7cdd9d tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-detach_volume" by "detach_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-059aea5d-63df-4cac-8fac-523dba7cdd9d tempest-VolumesActionsTest-455952201 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-059aea5d-63df-4cac-8fac-523dba7cdd9d tempest-VolumesActionsTest-455952201 None] Detaching volume 30f492dc-f8cc-44dd-bb38-84615e225269 from instance 7643934d-e419-4a49-a497-0eb1c2a3681f.
Nov 05 12:05:04 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196
Nov 05 12:05:04 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-059aea5d-63df-4cac-8fac-523dba7cdd9d tempest-VolumesActionsTest-455952201 None] Detach volume completed successfully.
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-059aea5d-63df-4cac-8fac-523dba7cdd9d tempest-VolumesActionsTest-455952201 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-detach_volume" released by "detach_volume" :: held 0.130s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ef9083b0-9fcd-4d93-8609-a2ab8bece061 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-detach_volume" by "detach_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ef9083b0-9fcd-4d93-8609-a2ab8bece061 tempest-VolumesActionsTest-2127965474 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ef9083b0-9fcd-4d93-8609-a2ab8bece061 tempest-VolumesActionsTest-2127965474 None] Volume detach called, but volume not attached.
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ef9083b0-9fcd-4d93-8609-a2ab8bece061 tempest-VolumesActionsTest-2127965474 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:04 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" returned: 0 in 0.644s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:04 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba
Nov 05 12:05:04 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Acquiring lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Acquiring lock "cinder-quobyte-30f492dc-f8cc-44dd-bb38-84615e225269" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Lock "cinder-quobyte-30f492dc-f8cc-44dd-bb38-84615e225269" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff4cadb-c7ba-4569-9b21-a917a3fd06d0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:05 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269
Nov 05 12:05:05 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:05 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269" returned: 0 in 0.762s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:05 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269
Nov 05 12:05:05 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:06 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-30f492dc-f8cc-44dd-bb38-84615e225269" returned: 0 in 0.736s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Lock "cinder-quobyte-30f492dc-f8cc-44dd-bb38-84615e225269" released by "delete_volume" :: held 1.603s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:06 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Created reservations ['8f4a3b64-fd2d-42b9-8abe-f55ece396db0', 'eb9c0068-e470-4af1-89c4-93752a28e9bd', 'f54dab65-adc7-4cc9-9162-bb9e0d653d96', '11967aee-113b-433d-b137-232fa063afaf'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:07 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:07 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:08 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 1.354s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:08 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:08 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Deleted volume successfully.
Nov 05 12:05:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2780a0b9-3384-4619-9868-53576c54629c tempest-VolumesActionsTest-2127965474 None] Lock "cinder-30f492dc-f8cc-44dd-bb38-84615e225269-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:05:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:13 devstack sudo[100002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:13 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:14 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.680s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:05:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:05:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (23800098-8a77-477a-bb99-8354bbdeda9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e16d544-3e4f-424f-84bc-f361fb6a1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e16d544-3e4f-424f-84bc-f361fb6a1efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053398152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fa95b1-18c0-4530-bcc6-938c7fff6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:15Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6615151-1ff3-4670-b9d5-f0c347d80a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6615151-1ff3-4670-b9d5-f0c347d80a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04509779-c536-46a9-86a2-d5bcdaa5e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04509779-c536-46a9-86a2-d5bcdaa5e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fa95b1-18c0-4530-bcc6-938c7fff6336', 'volume_name': 'volume-44fa95b1-18c0-4530-bcc6-938c7fff6336', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08427861-7d24-4dcd-88ff-12048264ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08427861-7d24-4dcd-88ff-12048264ef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e376ec-af2c-4cdf-90e9-eef91611a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:15 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Volume 44fa95b1-18c0-4530-bcc6-938c7fff6336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fa95b1-18c0-4530-bcc6-938c7fff6336', 'volume_size': 1}
Nov 05 12:05:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:16 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba" returned: 0 in 12.310s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:16 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196, size 1024.00 MB, duration 12.31 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:05:16 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Converted 1024.00 MB image at 83.18 MB/s
Nov 05 12:05:16 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:16 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba
Nov 05 12:05:16 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:17 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba" returned: 0 in 0.265s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-c1e23440-785f-4c6d-877e-bee6873940ba" released by "_copy_volume_from_snapshot" :: held 14.116s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-43112fd3-c1c9-41d8-969d-67d140f1a76b-c1e23440-785f-4c6d-877e-bee6873940ba" released by "_create_volume_from_snapshot" :: held 14.217s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.258s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053398152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fa95b1-18c0-4530-bcc6-938c7fff6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:15Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Creating volume 44fa95b1-18c0-4530-bcc6-938c7fff6336 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:17 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:17 devstack sudo[100012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336 1073741824
Nov 05 12:05:17 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9df6791e-d709-4460-abe0-3410b442e7d9 tempest-GroupSnapshotsTest-11402096 None] Create group from source-snapshot-3ff05ed4-3700-4437-94bf-f1373772763a completed successfully.
Nov 05 12:05:17 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336 1073741824" returned: 0 in 0.528s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:17 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336
Nov 05 12:05:17 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:18 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336" returned: 0 in 0.291s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e376ec-af2c-4cdf-90e9-eef91611a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fa95b1-18c0-4530-bcc6-938c7fff6336', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9d1f89-a623-4dbf-b016-5deb6226cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:18 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Volume volume-44fa95b1-18c0-4530-bcc6-938c7fff6336 (44fa95b1-18c0-4530-bcc6-938c7fff6336): created successfully
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9d1f89-a623-4dbf-b016-5deb6226cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (23800098-8a77-477a-bb99-8354bbdeda9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6cf91fcc-431f-443a-83f4-9cae92d856ab tempest-VolumesActionsTest-2127965474 None] Created volume successfully.
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-c1e23440-785f-4c6d-877e-bee6873940ba" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-c1e23440-785f-4c6d-877e-bee6873940ba" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0202a0-5bf2-4afc-a0d0-18087591f55f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:18 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba
Nov 05 12:05:18 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-44fa95b1-18c0-4530-bcc6-938c7fff6336-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Lock "cinder-44fa95b1-18c0-4530-bcc6-938c7fff6336-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-quobyte-44fa95b1-18c0-4530-bcc6-938c7fff6336" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-44fa95b1-18c0-4530-bcc6-938c7fff6336" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05b0c5-8c6e-434e-b8f5-36d436823b18]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba" returned: 0 in 0.431s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack sudo[100026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba
Nov 05 12:05:19 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:19 devstack sudo[100022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336
Nov 05 12:05:19 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:19 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1e23440-785f-4c6d-877e-bee6873940ba" returned: 0 in 0.248s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-c1e23440-785f-4c6d-877e-bee6873940ba" released by "delete_volume" :: held 0.745s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:19 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Created reservations ['3344a4f5-c4cd-40bb-a119-228ebaa2ad29'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336" returned: 0 in 0.470s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack sudo[100033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336
Nov 05 12:05:19 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:19 devstack cinder-volume[87317]: WARNING cinder.quota [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-591853639 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-591853639, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:05:19 devstack cinder-volume[87317]: WARNING cinder.quota [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-591853639 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-591853639, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Created reservations ['45c3e593-e572-47a8-8d2c-dfe0e98da0f0', 'e9a28d74-0dd2-483d-9336-feae8579820b', '63b2584e-ee28-4491-a879-53d7a9505162', 'cb438c17-f38d-43bc-bc46-7bf569a72b29'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:19 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:19 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44fa95b1-18c0-4530-bcc6-938c7fff6336" returned: 0 in 0.309s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-44fa95b1-18c0-4530-bcc6-938c7fff6336" released by "delete_volume" :: held 0.836s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Created reservations ['2b6d97c8-6ae6-4ff3-9608-e190e9c18042', 'c693ed31-f180-4b8e-b3e0-745234df4070', '9a40a271-6cbc-4cc5-a911-353a5cf12153', '313887e9-be0e-49e2-977b-c8a068e9ec69'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:19 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.311s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:19 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e8fabbdd-7b5b-4834-ab27-29841d5fa77f tempest-GroupSnapshotsTest-11402096 None] Delete group completed successfully.
Nov 05 12:05:19 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:19 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:19 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] group_snapshot 3ff05ed4-3700-4437-94bf-f1373772763a: deleting
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] group_snapshot 3ff05ed4-3700-4437-94bf-f1373772763a: deleting {{(pid=87317) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-43112fd3-c1c9-41d8-969d-67d140f1a76b" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-43112fd3-c1c9-41d8-969d-67d140f1a76b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Deleting offline snapshot 43112fd3-c1c9-41d8-969d-67d140f1a76b of volume a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] snapshot_file for this snap is: volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e201f3de-b9fd-4ff1-b735-f75ecb0c5690]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:20 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.421s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:20 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Deleted volume successfully.
Nov 05 12:05:20 devstack sudo[100041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b
Nov 05 12:05:20 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d6a03de-f857-4dc2-99d0-8ba9c9bb2344 tempest-VolumesActionsTest-455952201 None] Lock "cinder-44fa95b1-18c0-4530-bcc6-938c7fff6336-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:20 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b" returned: 0 in 0.494s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c6f72b-b7ac-4ca0-b121-77bfc290846b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (81917dd0-cb9f-48f3-b172-6fba80cbfe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505c0c0b-efe8-4c12-8c2a-3919f30f9163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:20 devstack sudo[100047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196
Nov 05 12:05:20 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505c0c0b-efe8-4c12-8c2a-3919f30f9163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-893227881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c99609-ee83-4f44-8cd3-4767cb7f86f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:21Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686159e1-4cc0-48cb-a8e8-adfb295562aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686159e1-4cc0-48cb-a8e8-adfb295562aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e7fe10-3fae-4509-b5ce-6ae4be044a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e7fe10-3fae-4509-b5ce-6ae4be044a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c99609-ee83-4f44-8cd3-4767cb7f86f2', 'volume_name': 'volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7ec206-291b-4572-bc21-3aaae172817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7ec206-291b-4572-bc21-3aaae172817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d02257d-48ef-4874-84c7-60717d0a2fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:20 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Volume 37c99609-ee83-4f44-8cd3-4767cb7f86f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2', 'volume_size': 1}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-893227881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c99609-ee83-4f44-8cd3-4767cb7f86f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:21Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Creating volume 37c99609-ee83-4f44-8cd3-4767cb7f86f2 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:20 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:20 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2 1073741824
Nov 05 12:05:20 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:21 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" returned: 0 in 0.613s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:21 devstack sudo[100058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b
Nov 05 12:05:21 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:21 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2 1073741824" returned: 0 in 0.553s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:21 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2
Nov 05 12:05:21 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:21 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b" returned: 0 in 0.455s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:21 devstack sudo[100066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b
Nov 05 12:05:21 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:21 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2" returned: 0 in 0.344s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d02257d-48ef-4874-84c7-60717d0a2fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e8b7ff-cc54-4b81-9f97-ca951c133e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:21 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Volume volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2 (37c99609-ee83-4f44-8cd3-4767cb7f86f2): created successfully
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e8b7ff-cc54-4b81-9f97-ca951c133e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (81917dd0-cb9f-48f3-b172-6fba80cbfe04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-39120d83-901e-4b13-a002-eff8feec1cc6 tempest-VolumesActionsTest-2127965474 None] Created volume successfully.
Nov 05 12:05:22 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196.43112fd3-c1c9-41d8-969d-67d140f1a76b" returned: 0 in 0.328s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-43112fd3-c1c9-41d8-969d-67d140f1a76b" released by "_delete_snapshot" :: held 2.011s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" released by "delete_snapshot" :: held 2.047s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:22 devstack cinder-volume[87317]: WARNING cinder.quota [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-591853639 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-591853639, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] Created reservations ['daec8132-b010-40b5-aaa0-da7348303dce', 'b9c2512e-e19b-4c52-bf3d-a4fb2c1888d9', '047e0775-5acd-4b1d-a701-cb38781e166b', '0d704e23-bc7d-4342-bcd8-340cfae53c31'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:22 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2b60d9e7-510a-40e0-9f6b-55c4717108ff tempest-GroupSnapshotsTest-11402096 None] group_snapshot 3ff05ed4-3700-4437-94bf-f1373772763a: deleted successfully
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf515b-72fd-4cde-89cd-964f864cdc78]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:23 devstack sudo[100069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196
Nov 05 12:05:23 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-37c99609-ee83-4f44-8cd3-4767cb7f86f2-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Lock "cinder-37c99609-ee83-4f44-8cd3-4767cb7f86f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-quobyte-37c99609-ee83-4f44-8cd3-4767cb7f86f2" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-37c99609-ee83-4f44-8cd3-4767cb7f86f2" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86870c2-1074-4a94-b191-beec72a8b7eb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:23 devstack sudo[100071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2
Nov 05 12:05:23 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:23 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" returned: 0 in 0.585s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:23 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196
Nov 05 12:05:23 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:23 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2" returned: 0 in 0.479s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:23 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2
Nov 05 12:05:23 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:23 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" returned: 0 in 0.334s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-a01d19a7-a6f1-4213-bd4d-d70c3aa26196" released by "delete_volume" :: held 1.031s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Created reservations ['2be51bc7-88d4-4e8c-a3fc-ddea0b635904'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:23 devstack cinder-volume[87317]: WARNING cinder.db.api [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-591853639']
Nov 05 12:05:23 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Created reservations ['f59068aa-76f6-46fc-a31d-bcab17e8798a', '71ef2b7d-515b-4531-b3c8-072a404ec615', '1ea7d641-7c76-421e-93d2-2ce1795483db', '27fc03a9-e497-4e5d-9dbc-a910f56ca9ef'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:24 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-37c99609-ee83-4f44-8cd3-4767cb7f86f2" returned: 0 in 0.316s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-37c99609-ee83-4f44-8cd3-4767cb7f86f2" released by "delete_volume" :: held 0.854s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:24 devstack sudo[100088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:24 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Created reservations ['213957e8-334e-410a-a670-8e43a3242989', '96da5b3c-71b9-4aca-8f81-a0404d235e2d', '41f1ffb7-6cbd-40d1-8f76-762e1afa5f42', '7f2e446e-1c91-4366-b697-089a348fe3db'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:24 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:24 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:24 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.357s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-90c168ae-c882-4882-81a9-ec58e5d0878e tempest-GroupSnapshotsTest-11402096 None] Delete group completed successfully.
Nov 05 12:05:24 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.357s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Deleted volume successfully.
Nov 05 12:05:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8153a307-f7fc-4f3f-af88-f4564a4c1018 tempest-VolumesActionsTest-455952201 None] Lock "cinder-37c99609-ee83-4f44-8cd3-4767cb7f86f2-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (58e9b36c-98e3-43a3-8764-80762145b3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d700a1a2-ea97-44af-b51e-d170c2e6de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d700a1a2-ea97-44af-b51e-d170c2e6de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-120788861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f01a8e0-f654-4c28-874d-1c166b5e956e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:25Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dc4bc1-d8a3-4292-b9a0-ac89c850c609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dc4bc1-d8a3-4292-b9a0-ac89c850c609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f40781-6e38-44be-a921-dabdf2e81264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f40781-6e38-44be-a921-dabdf2e81264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f01a8e0-f654-4c28-874d-1c166b5e956e', 'volume_name': 'volume-3f01a8e0-f654-4c28-874d-1c166b5e956e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7657e3-9528-4cec-a29c-4eafcbeb4459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7657e3-9528-4cec-a29c-4eafcbeb4459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da190ee2-6fe9-46c9-aee5-241617a12663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:25 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Volume 3f01a8e0-f654-4c28-874d-1c166b5e956e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f01a8e0-f654-4c28-874d-1c166b5e956e', 'volume_size': 1}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-120788861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f01a8e0-f654-4c28-874d-1c166b5e956e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:25Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Creating volume 3f01a8e0-f654-4c28-874d-1c166b5e956e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:25 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:25 devstack sudo[100094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e 1073741824
Nov 05 12:05:25 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9ff4043e-e7f1-4668-9d90-5cc36916bb15 tempest-GroupSnapshotsTest-11402096 None] Group tempest-GroupSnapshotsTest-Group-1029752694: creating
Nov 05 12:05:25 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e 1073741824" returned: 0 in 0.602s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9ff4043e-e7f1-4668-9d90-5cc36916bb15 tempest-GroupSnapshotsTest-11402096 None] Group tempest-GroupSnapshotsTest-Group-1029752694: created successfully
Nov 05 12:05:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9ff4043e-e7f1-4668-9d90-5cc36916bb15 tempest-GroupSnapshotsTest-11402096 None] Create group completed successfully.
Nov 05 12:05:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:25 devstack sudo[100100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e
Nov 05 12:05:25 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:26 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e" returned: 0 in 0.330s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da190ee2-6fe9-46c9-aee5-241617a12663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f01a8e0-f654-4c28-874d-1c166b5e956e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27635e5-9e29-4c1c-855c-8b1b34e0712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:26 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Volume volume-3f01a8e0-f654-4c28-874d-1c166b5e956e (3f01a8e0-f654-4c28-874d-1c166b5e956e): created successfully
Nov 05 12:05:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27635e5-9e29-4c1c-855c-8b1b34e0712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (58e9b36c-98e3-43a3-8764-80762145b3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:26 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-72ebc83c-274b-470d-b5b8-c73bca1dc814 tempest-VolumesActionsTest-2127965474 None] Created volume successfully.
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-3f01a8e0-f654-4c28-874d-1c166b5e956e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Lock "cinder-3f01a8e0-f654-4c28-874d-1c166b5e956e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-quobyte-3f01a8e0-f654-4c28-874d-1c166b5e956e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-3f01a8e0-f654-4c28-874d-1c166b5e956e" acquired by "delete_volume" :: waited 0.034s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (02c39ac6-da30-4959-b68c-46a6990d0a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1eed5b6-e0e2-4592-ad4d-384c7e28532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaa5697-a319-4264-9df9-178002834867]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1eed5b6-e0e2-4592-ad4d-384c7e28532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197714029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f248c47b-27cc-4d5e-b7ff-89d9ef72ada7,host='devstack@QuobyteHD#QuobyteHD',id=2b5df0ce-fed9-47e4-a61a-07e6761dc7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:28Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81e83591-5fb9-4116-a0ff-4e00d722fedf),volume_type_id=81e83591-5fb9-4116-a0ff-4e00d722fedf)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82506cd3-be65-41ee-b8b0-d70d9eef9411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82506cd3-be65-41ee-b8b0-d70d9eef9411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1da1ec-2df0-4352-8220-fb3cd1f80be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1da1ec-2df0-4352-8220-fb3cd1f80be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5df0ce-fed9-47e4-a61a-07e6761dc7aa', 'volume_name': 'volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113dec92-1bfd-435a-80e8-46c6d07ef1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113dec92-1bfd-435a-80e8-46c6d07ef1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ceb05-1189-43b2-abf1-a4f974eccaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Volume 2b5df0ce-fed9-47e4-a61a-07e6761dc7aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa', 'volume_size': 1}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f248c47b-27cc-4d5e-b7ff-89d9ef72ada7,created_at=2026-11-05T11:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197714029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f248c47b-27cc-4d5e-b7ff-89d9ef72ada7,host='devstack@QuobyteHD#QuobyteHD',id=2b5df0ce-fed9-47e4-a61a-07e6761dc7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:28Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81e83591-5fb9-4116-a0ff-4e00d722fedf),volume_type_id=81e83591-5fb9-4116-a0ff-4e00d722fedf)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Creating volume 2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:27 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:27 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e
Nov 05 12:05:27 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:27 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa 1073741824
Nov 05 12:05:27 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:28 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e" returned: 0 in 0.466s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:28 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e
Nov 05 12:05:28 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:28 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa 1073741824" returned: 0 in 0.592s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:28 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f01a8e0-f654-4c28-874d-1c166b5e956e" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-3f01a8e0-f654-4c28-874d-1c166b5e956e" released by "delete_volume" :: held 0.855s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:28 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa
Nov 05 12:05:28 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Created reservations ['46578f98-88c9-43eb-8160-cdd31520f059', '29fee7b0-2f03-4891-b094-f6322de37f3a', '7a8b8c61-26af-4008-a45c-806accc75383', 'a9c3c1ae-0859-4c8f-b80f-6acd06d90790'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:28 devstack sudo[100156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:28 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:28 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" returned: 0 in 0.372s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026ceb05-1189-43b2-abf1-a4f974eccaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e366916a-3f97-4ae8-b580-5a3a7b746350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:28 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Volume volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa (2b5df0ce-fed9-47e4-a61a-07e6761dc7aa): created successfully
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e366916a-3f97-4ae8-b580-5a3a7b746350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (02c39ac6-da30-4959-b68c-46a6990d0a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-df216f7e-03be-4d2f-adcd-e6b6aee35ec3 tempest-GroupSnapshotsTest-11402096 None] Created volume successfully.
Nov 05 12:05:29 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.348s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:29 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Deleted volume successfully.
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e211a76b-aec4-4cc7-a07f-9ad6b0148e40 tempest-VolumesActionsTest-455952201 None] Lock "cinder-3f01a8e0-f654-4c28-874d-1c166b5e956e-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (91e4fc41-06cc-4fcf-8d44-2fb4d4930bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10cc552-7c9c-4eee-aed2-7690271da109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10cc552-7c9c-4eee-aed2-7690271da109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343463009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54414efc-cf41-4be1-8fa5-0e8c61f39ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:29Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc7e40-06d5-4d02-955b-1de6226215fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc7e40-06d5-4d02-955b-1de6226215fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12c907d-a57f-4619-acf2-6361845cd175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12c907d-a57f-4619-acf2-6361845cd175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54414efc-cf41-4be1-8fa5-0e8c61f39ae5', 'volume_name': 'volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c2d3a1-cf8f-4216-91a6-78466fe729e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c2d3a1-cf8f-4216-91a6-78466fe729e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0338132-f1b7-4dfa-952d-e0ce53fda520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:29 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Volume 54414efc-cf41-4be1-8fa5-0e8c61f39ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5', 'volume_size': 1}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343463009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54414efc-cf41-4be1-8fa5-0e8c61f39ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:29Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Creating volume 54414efc-cf41-4be1-8fa5-0e8c61f39ae5 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:29 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:29 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5 1073741824
Nov 05 12:05:29 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:29 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5 1073741824" returned: 0 in 0.476s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:29 devstack sudo[100166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5
Nov 05 12:05:29 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:30 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5" returned: 0 in 0.290s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0338132-f1b7-4dfa-952d-e0ce53fda520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2a2274-0323-4b46-acfc-71f04bb729db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Volume volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5 (54414efc-cf41-4be1-8fa5-0e8c61f39ae5): created successfully
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2a2274-0323-4b46-acfc-71f04bb729db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (91e4fc41-06cc-4fcf-8d44-2fb4d4930bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c0822d56-593a-4faf-9847-f6a1e7c7895f tempest-VolumesActionsTest-2127965474 None] Created volume successfully.
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (25ca22d4-32d8-40b2-af59-8279542d9896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195b7064-4b84-4149-a1a8-98a37c80813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195b7064-4b84-4149-a1a8-98a37c80813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1908467795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f248c47b-27cc-4d5e-b7ff-89d9ef72ada7,host='devstack@QuobyteHD#QuobyteHD',id=bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:31Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81e83591-5fb9-4116-a0ff-4e00d722fedf),volume_type_id=81e83591-5fb9-4116-a0ff-4e00d722fedf)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e6f782-a51e-49ef-b94d-deb7d00b7ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e6f782-a51e-49ef-b94d-deb7d00b7ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3062a57a-181a-4e7c-ab50-972465147732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3062a57a-181a-4e7c-ab50-972465147732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e', 'volume_name': 'volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1324d332-d058-4743-bd66-a63415b886c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1324d332-d058-4743-bd66-a63415b886c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b361ebf6-a344-4086-99e3-43d68b7e33c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Volume bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e', 'volume_size': 1}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f248c47b-27cc-4d5e-b7ff-89d9ef72ada7,created_at=2026-11-05T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1908467795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f248c47b-27cc-4d5e-b7ff-89d9ef72ada7,host='devstack@QuobyteHD#QuobyteHD',id=bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:31Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81e83591-5fb9-4116-a0ff-4e00d722fedf),volume_type_id=81e83591-5fb9-4116-a0ff-4e00d722fedf)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Creating volume bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:30 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:30 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e 1073741824
Nov 05 12:05:30 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:31 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e 1073741824" returned: 0 in 0.491s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:31 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e
Nov 05 12:05:31 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-54414efc-cf41-4be1-8fa5-0e8c61f39ae5-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Lock "cinder-54414efc-cf41-4be1-8fa5-0e8c61f39ae5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Acquiring lock "cinder-quobyte-54414efc-cf41-4be1-8fa5-0e8c61f39ae5" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:31 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" returned: 0 in 0.356s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-54414efc-cf41-4be1-8fa5-0e8c61f39ae5" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b361ebf6-a344-4086-99e3-43d68b7e33c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50e1111-00fe-406e-82bf-f91e7fc3a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[111635e1-4096-4894-9a36-7e1cf7a4f5e8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:31 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Volume volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e (bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e): created successfully
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50e1111-00fe-406e-82bf-f91e7fc3a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (25ca22d4-32d8-40b2-af59-8279542d9896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:31 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c7b018fc-b29f-4321-b875-93be1f49a3cc tempest-GroupSnapshotsTest-11402096 None] Created volume successfully.
Nov 05 12:05:31 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5
Nov 05 12:05:31 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-21a20f64-7b9a-474b-9b5d-26a1e300509d tempest-GroupSnapshotsTest-11402096 None] Update group completed successfully.
Nov 05 12:05:32 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5" returned: 0 in 0.435s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:32 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5
Nov 05 12:05:32 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:32 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-54414efc-cf41-4be1-8fa5-0e8c61f39ae5" returned: 0 in 0.284s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Lock "cinder-quobyte-54414efc-cf41-4be1-8fa5-0e8c61f39ae5" released by "delete_volume" :: held 0.769s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Created reservations ['8e8f6131-82f0-47e7-a96b-288a69e66bc8', '73a842a8-2cf9-4f9f-9957-a9edf8e318d5', '402fce78-aed5-4a5b-9aa7-014e588a2c9d', '27ac033e-bf57-436a-8dd9-ac05ec072e0a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:32 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:32 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:32 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.302s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Deleted volume successfully.
Nov 05 12:05:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e3532bf7-e3e1-4cf1-a371-4cf7d999a5d9 tempest-VolumesActionsTest-455952201 None] Lock "cinder-54414efc-cf41-4be1-8fa5-0e8c61f39ae5-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2e2fa27b-407e-48c1-8441-a6696b964f92 tempest-GroupSnapshotsTest-11402096 None] Update group completed successfully.
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (a01b5f98-84f6-4660-9d73-34473a62ffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bdcec8-23db-499c-90ea-68af63e85b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bdcec8-23db-499c-90ea-68af63e85b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414819590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64485b8e-c171-44bb-9329-b8a7e34c3509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:33Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a7b033-6d59-4af9-92e6-ec83b4eb776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a7b033-6d59-4af9-92e6-ec83b4eb776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394bc056-00b1-44ef-b816-453db60d6cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394bc056-00b1-44ef-b816-453db60d6cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64485b8e-c171-44bb-9329-b8a7e34c3509', 'volume_name': 'volume-64485b8e-c171-44bb-9329-b8a7e34c3509', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ac72f4-15ee-46ad-83f5-b6865035b9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ac72f4-15ee-46ad-83f5-b6865035b9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd48cf9d-aa69-40da-999e-ecc29a7b6979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:33 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Volume 64485b8e-c171-44bb-9329-b8a7e34c3509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64485b8e-c171-44bb-9329-b8a7e34c3509', 'volume_size': 1}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414819590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64485b8e-c171-44bb-9329-b8a7e34c3509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4c15d9f54c464abaa52633ecb704dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:33Z,use_quota=True,user_id='6b283fec1d864e758622f0e14b72aec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Creating volume 64485b8e-c171-44bb-9329-b8a7e34c3509 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:33 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:33 devstack sudo[100189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509 1073741824
Nov 05 12:05:33 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:33 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509 1073741824" returned: 0 in 0.463s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:33 devstack sudo[100196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509
Nov 05 12:05:33 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:34 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509" returned: 0 in 0.250s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd48cf9d-aa69-40da-999e-ecc29a7b6979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64485b8e-c171-44bb-9329-b8a7e34c3509', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee582b97-f54f-44f4-b138-311fe90d2802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Volume volume-64485b8e-c171-44bb-9329-b8a7e34c3509 (64485b8e-c171-44bb-9329-b8a7e34c3509): created successfully
Nov 05 12:05:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee582b97-f54f-44f4-b138-311fe90d2802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Flow 'volume_create_manager' (a01b5f98-84f6-4660-9d73-34473a62ffbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a5af4489-cc5e-42ee-ac35-75304c8c55b0 tempest-VolumesActionsTest-2127965474 None] Created volume successfully.
Nov 05 12:05:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4f620b1f-bfa7-4c21-b5dc-4df01bf3924a tempest-GroupSnapshotsTest-11402096 None] Update group completed successfully.
Nov 05 12:05:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6333f2a3-b85f-4e1b-9443-0aa57e599541 tempest-GroupSnapshotsTest-11402096 None] Update group completed successfully.
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "cinder-64485b8e-c171-44bb-9329-b8a7e34c3509-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Lock "cinder-64485b8e-c171-44bb-9329-b8a7e34c3509-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "cinder-quobyte-64485b8e-c171-44bb-9329-b8a7e34c3509" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Lock "cinder-quobyte-64485b8e-c171-44bb-9329-b8a7e34c3509" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce3327b-c006-47da-847b-52a4e20f9e39]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:36 devstack sudo[100199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509
Nov 05 12:05:36 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:36 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509" returned: 0 in 0.444s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:36 devstack sudo[100205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509
Nov 05 12:05:36 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:37 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-64485b8e-c171-44bb-9329-b8a7e34c3509" returned: 0 in 0.302s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Lock "cinder-quobyte-64485b8e-c171-44bb-9329-b8a7e34c3509" released by "delete_volume" :: held 0.811s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Created reservations ['432499c6-0828-4b1d-aa86-ba5bf7af5e4e', 'a45d8f88-68a4-44f1-a282-19e9ea4094cb', '53f3c33b-414f-4b90-9764-d5f49127b1cc', 'ae252daa-7c9a-499a-afc5-cc04dffa3bc4'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:37 devstack sudo[100208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] GroupSnapshot 988d703b-e233-404f-bb2c-892e3c6182b3: creating.
Nov 05 12:05:37 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Group snapshot 988d703b-e233-404f-bb2c-892e3c6182b3: creating. {{(pid=87317) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Creating offline snapshot 4091a96e-7cb3-4bfa-8ea2-b2729d0f606d of volume 2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e960e0-9503-4219-a3f4-029aaa9518ac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:37 devstack sudo[100210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa
Nov 05 12:05:37 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:37 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.299s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Deleted volume successfully.
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bff4037f-ba2c-444d-b4f3-132db9c38ae0 tempest-VolumesActionsTest-2127965474 None] Lock "cinder-64485b8e-c171-44bb-9329-b8a7e34c3509-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:37 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" returned: 0 in 0.423s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:37 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d 1G
Nov 05 12:05:37 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:38 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d 1G" returned: 0 in 0.479s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:38 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d
Nov 05 12:05:38 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:38 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" returned: 0 in 0.403s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:38 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:38 devstack sudo[100228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d
Nov 05 12:05:38 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:39 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:39 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.info
Nov 05 12:05:39 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:39 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.info" returned: 0 in 0.323s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:39 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:39 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.info
Nov 05 12:05:39 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:39 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.info" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Creating offline snapshot 679fd079-591a-4d80-abba-a1a5b328da9a of volume bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a404f1d2-3fa3-4288-b20e-1cef4f8d50f3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:39 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e
Nov 05 12:05:39 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:40 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" returned: 0 in 0.437s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:40 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a 1G
Nov 05 12:05:40 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:40 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a 1G" returned: 0 in 0.480s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:40 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a
Nov 05 12:05:40 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:40 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a" returned: 0 in 0.337s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:40 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:41 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a
Nov 05 12:05:41 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:41 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.info
Nov 05 12:05:41 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.info" returned: 0 in 0.371s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:41 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:41 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.info
Nov 05 12:05:41 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:41 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.info" returned: 0 in 0.297s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-779d3919-d66b-43c9-bc61-7a9671d764ea tempest-GroupSnapshotsTest-11402096 None] group_snapshot 988d703b-e233-404f-bb2c-892e3c6182b3: created successfully
Nov 05 12:05:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] group_snapshot 988d703b-e233-404f-bb2c-892e3c6182b3: deleting
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] group_snapshot 988d703b-e233-404f-bb2c-892e3c6182b3: deleting {{(pid=87317) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Deleting offline snapshot 4091a96e-7cb3-4bfa-8ea2-b2729d0f606d of volume 2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] snapshot_file for this snap is: volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8dd3e5-ee6b-4bd3-900a-e8858636fed2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:43 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d
Nov 05 12:05:43 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:43 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" returned: 0 in 0.446s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0c5aad-ef23-4766-a937-9d9a92baccaa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:43 devstack sudo[100268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa
Nov 05 12:05:43 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:43 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" returned: 0 in 0.447s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:43 devstack sudo[100274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d
Nov 05 12:05:43 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:44 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" returned: 0 in 0.382s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:44 devstack sudo[100279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d
Nov 05 12:05:44 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:44 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa.4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" returned: 0 in 0.290s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-4091a96e-7cb3-4bfa-8ea2-b2729d0f606d" released by "_delete_snapshot" :: held 1.694s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" released by "delete_snapshot" :: held 1.726s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-679fd079-591a-4d80-abba-a1a5b328da9a" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-679fd079-591a-4d80-abba-a1a5b328da9a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Deleting offline snapshot 679fd079-591a-4d80-abba-a1a5b328da9a of volume bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] snapshot_file for this snap is: volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf8a43-45da-44ee-a6f9-9f1e96cecb74]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:44 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a
Nov 05 12:05:44 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:45 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a" returned: 0 in 0.393s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:05:45 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[227a40b0-07c0-4581-94e2-d88ae5691710]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:45 devstack sudo[100288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e
Nov 05 12:05:45 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:45 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" returned: 0 in 0.451s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:45 devstack sudo[100293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a
Nov 05 12:05:45 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:46 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a" returned: 0 in 0.421s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:46 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a
Nov 05 12:05:46 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:46 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e.679fd079-591a-4d80-abba-a1a5b328da9a" returned: 0 in 0.319s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-679fd079-591a-4d80-abba-a1a5b328da9a" released by "_delete_snapshot" :: held 1.709s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" released by "delete_snapshot" :: held 1.735s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:46 devstack cinder-volume[87317]: WARNING cinder.quota [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1615877663 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1615877663, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:05:46 devstack cinder-volume[87317]: WARNING cinder.quota [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1615877663 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1615877663, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:05:46 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Created reservations ['bfd5dea6-ead7-4b9f-8b35-8a9f8c823673', 'b565534e-907a-4706-801f-98e8d473c2fe', 'c12d6213-a843-4d8d-a482-ba5f3d933cee', '276acd90-f745-4a51-a55d-28896632f7c7'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:46 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] Created reservations ['57e548ed-c6b9-41b3-95c4-7ad074768f98', '299d2319-dd5e-4287-b9ec-7c60cd5dd802', '2c16c25b-2964-49c6-8a9f-63c1cee3c2f6', '6b8d79be-d810-46c6-aefd-2b33688dab2a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0e2e6fc6-9c88-40d7-81ac-9740c96035f6 tempest-GroupSnapshotsTest-11402096 None] group_snapshot 988d703b-e233-404f-bb2c-892e3c6182b3: deleted successfully
Nov 05 12:05:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:47 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef99a7-8da1-46a1-8eed-be0725a0174d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:48 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa
Nov 05 12:05:48 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:48 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" returned: 0 in 0.476s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:48 devstack sudo[100307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa
Nov 05 12:05:48 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:48 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" returned: 0 in 0.302s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-2b5df0ce-fed9-47e4-a61a-07e6761dc7aa" released by "delete_volume" :: held 0.879s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9f6bd3-6dfa-4862-8231-da6848cf7297]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:49 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e
Nov 05 12:05:49 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:49 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" returned: 0 in 0.527s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:49 devstack sudo[100319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e
Nov 05 12:05:49 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:49 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" returned: 0 in 0.334s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-bad8b6ca-d05c-4f3f-b31f-bd72cb7d6e4e" released by "delete_volume" :: held 0.981s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:49 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=130,cinder:SELECT=138,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:05:49 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Created reservations ['fccfc9ba-9d4c-4981-9347-6c14a8ab3f4f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:49 devstack cinder-volume[87317]: WARNING cinder.quota [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1615877663 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1615877663, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Created reservations ['eb74439f-9664-4052-b872-006a8d2acc60', 'f6cdb26c-2268-4077-ac05-64ab403643c1', 'f4ff0c27-6d8e-4d36-9e30-c7c0c3d747d4', '2ea9a018-f22f-459c-9a04-a54ba622616f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=134,cinder:UPDATE=149,cinder:DELETE=8,cinder:INSERT=32 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Created reservations ['a439e14d-5d4d-4884-9f44-760f00857930', 'ca85dc80-b079-4a17-9b93-6d2c4cea2997', '6acdb356-b7dd-48f3-8587-583df8bb86cd', '438d7f06-472e-409b-9fff-4a971df11704'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:50 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:50 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:50 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.476s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:50 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:50 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1c5ad97e-0984-4948-957a-fc1a7a2b078b tempest-GroupSnapshotsTest-11402096 None] Delete group completed successfully.
Nov 05 12:05:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-19873168-3e3f-4f4d-933e-97c074e15ed1 tempest-GroupSnapshotsTest-11402096 None] Group tempest-GroupSnapshotsTest-Group-1251141260: creating
Nov 05 12:05:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-19873168-3e3f-4f4d-933e-97c074e15ed1 tempest-GroupSnapshotsTest-11402096 None] Group tempest-GroupSnapshotsTest-Group-1251141260: created successfully
Nov 05 12:05:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-19873168-3e3f-4f4d-933e-97c074e15ed1 tempest-GroupSnapshotsTest-11402096 None] Create group completed successfully.
Nov 05 12:05:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-8270e1a1-004b-4126-8e13-502dac50e370 tempest-TestShelveInstance-1369336254 None] Terminate volume connection completed successfully.
Nov 05 12:05:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-8270e1a1-004b-4126-8e13-502dac50e370 tempest-TestShelveInstance-1369336254 None] Deleting attachment ebfd5842-1a31-4454-bc2d-e06e34ea1088. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:05:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Acquiring lock "cinder-3690ccdc-82e8-48bb-8c07-59b5e149191e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Lock "cinder-3690ccdc-82e8-48bb-8c07-59b5e149191e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Acquiring lock "cinder-quobyte-3690ccdc-82e8-48bb-8c07-59b5e149191e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Lock "cinder-quobyte-3690ccdc-82e8-48bb-8c07-59b5e149191e" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[af412968-854d-405a-8851-8e71c7af5e1b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:53 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e
Nov 05 12:05:53 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (dea263d1-b226-486e-abaf-f87330132be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924f168c-f46f-477b-8b1d-626afe1838fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924f168c-f46f-477b-8b1d-626afe1838fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73897081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1222270-96ab-4c3d-8f88-2e2610733c29,host='devstack@QuobyteHD#QuobyteHD',id=b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:54Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffbd591c-bfda-4d9d-8d87-a31bf06ee745),volume_type_id=ffbd591c-bfda-4d9d-8d87-a31bf06ee745)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dbd347-11e6-4685-bde8-75a6c4582998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dbd347-11e6-4685-bde8-75a6c4582998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e7830-2bf0-4a2a-b306-0d226a70859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e7830-2bf0-4a2a-b306-0d226a70859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8', 'volume_name': 'volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86aa061-32b0-4865-bf8c-d7c7be05401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86aa061-32b0-4865-bf8c-d7c7be05401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4b5f5a-ccda-4de4-b283-ca1b49c1b715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Volume b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8', 'volume_size': 1}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a1222270-96ab-4c3d-8f88-2e2610733c29,created_at=2026-11-05T11:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73897081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1222270-96ab-4c3d-8f88-2e2610733c29,host='devstack@QuobyteHD#QuobyteHD',id=b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a13f67cb8d4498b58ca426c65d94f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:54Z,use_quota=True,user_id='fb3b3325c44a4c40a88e9ef5ab4502d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffbd591c-bfda-4d9d-8d87-a31bf06ee745),volume_type_id=ffbd591c-bfda-4d9d-8d87-a31bf06ee745)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Creating volume b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:54 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:54 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 1073741824
Nov 05 12:05:54 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:54 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e" returned: 0 in 0.768s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:54 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e
Nov 05 12:05:54 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:54 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3690ccdc-82e8-48bb-8c07-59b5e149191e" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Lock "cinder-quobyte-3690ccdc-82e8-48bb-8c07-59b5e149191e" released by "delete_volume" :: held 1.119s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.quota [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Created reservations ['873a510c-9518-4904-82ba-f87c55a0c396', '07d0ef19-6b3b-4f43-aeff-342dae4d5ef1', '8c1c4b4a-75c0-4f64-9fa1-f4a550c80329', '7876cb95-6557-4628-9610-8deeee702920'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:54 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:05:54 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:54 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 1073741824" returned: 0 in 0.583s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:54 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8
Nov 05 12:05:54 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:55 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.300s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG cinder.manager [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:05:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Deleted volume successfully.
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [req-dfea2d02-c9f9-4ee9-a029-168aa77fa209 req-b3f48955-beea-4a5f-91d9-ad037b29a1fa tempest-TestShelveInstance-1369336254 None] Lock "cinder-3690ccdc-82e8-48bb-8c07-59b5e149191e-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:05:55 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" returned: 0 in 0.310s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4b5f5a-ccda-4de4-b283-ca1b49c1b715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dfcddf-8317-497a-93ed-0dbd880a9c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Volume volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 (b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8): created successfully
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dfcddf-8317-497a-93ed-0dbd880a9c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Flow 'volume_create_manager' (dea263d1-b226-486e-abaf-f87330132be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e67d879e-dd3f-4729-91bc-e82f7218b927 tempest-GroupSnapshotsTest-11402096 None] Created volume successfully.
Nov 05 12:05:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] GroupSnapshot a5600912-9e41-4c71-86bb-7e7f95b70142: creating.
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Group snapshot a5600912-9e41-4c71-86bb-7e7f95b70142: creating. {{(pid=87317) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Creating offline snapshot f297e91c-3363-49fa-9907-13bda3c32793 of volume b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[574134ae-1441-4d07-a706-d519f5e47f51]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:56 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8
Nov 05 12:05:56 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:56 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" returned: 0 in 0.412s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:56 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 1G
Nov 05 12:05:56 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:57 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 1G" returned: 0 in 0.539s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:57 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793
Nov 05 12:05:57 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:57 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793" returned: 0 in 0.358s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:57 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:57 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793
Nov 05 12:05:57 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:57 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793" returned: 0 in 0.314s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:57 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.info
Nov 05 12:05:57 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:58 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.info" returned: 0 in 0.326s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:58 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:58 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.info
Nov 05 12:05:58 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:58 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.info" returned: 0 in 0.281s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-38732a18-6aab-4c25-b79b-70020c21c991 tempest-GroupSnapshotsTest-11402096 None] group_snapshot a5600912-9e41-4c71-86bb-7e7f95b70142: created successfully
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Flow 'volume_create_manager' (093b656c-e851-4cd4-b7b9-07d2a269a6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fc017f-fa30-4ad4-ad5f-9fd4482014de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fc017f-fa30-4ad4-ad5f-9fd4482014de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-302258441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382a62b4-9528-4d10-b90e-70fc3275319e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db486c2d94c14f35a63e8b46f214a65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:59Z,use_quota=True,user_id='626ec404942149808232d71547da03a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96eeb0d-347e-43c1-a99e-7c34f24b6427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96eeb0d-347e-43c1-a99e-7c34f24b6427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714d82ee-9016-4340-a6dd-ff89325119ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714d82ee-9016-4340-a6dd-ff89325119ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382a62b4-9528-4d10-b90e-70fc3275319e', 'volume_name': 'volume-382a62b4-9528-4d10-b90e-70fc3275319e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59843c0d-7e02-43ba-827e-d5097e954f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59843c0d-7e02-43ba-827e-d5097e954f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3928237a-12ac-4742-8a55-a0ef0591c23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Volume 382a62b4-9528-4d10-b90e-70fc3275319e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382a62b4-9528-4d10-b90e-70fc3275319e', 'volume_size': 1}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-302258441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382a62b4-9528-4d10-b90e-70fc3275319e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db486c2d94c14f35a63e8b46f214a65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:05:59Z,use_quota=True,user_id='626ec404942149808232d71547da03a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Creating volume 382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:05:58 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:05:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:58 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e 1073741824
Nov 05 12:05:58 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:59 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e 1073741824" returned: 0 in 0.505s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:59 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e
Nov 05 12:05:59 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] group_snapshot a5600912-9e41-4c71-86bb-7e7f95b70142: deleting
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] group_snapshot a5600912-9e41-4c71-86bb-7e7f95b70142: deleting {{(pid=87317) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-f297e91c-3363-49fa-9907-13bda3c32793" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-f297e91c-3363-49fa-9907-13bda3c32793" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Deleting offline snapshot f297e91c-3363-49fa-9907-13bda3c32793 of volume b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] snapshot_file for this snap is: volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f1463b-b8ef-469a-835f-e0afe0c15631]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:05:59 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e" returned: 0 in 0.331s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:05:59 devstack sudo[100414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793
Nov 05 12:05:59 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3928237a-12ac-4742-8a55-a0ef0591c23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382a62b4-9528-4d10-b90e-70fc3275319e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e560997-e0cb-4899-97d8-959828ac2f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:05:59 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Volume volume-382a62b4-9528-4d10-b90e-70fc3275319e (382a62b4-9528-4d10-b90e-70fc3275319e): created successfully
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e560997-e0cb-4899-97d8-959828ac2f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:05:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Flow 'volume_create_manager' (093b656c-e851-4cd4-b7b9-07d2a269a6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:05:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8c4ae01c-fbb4-48d8-bcb4-1cec8f9e8902 tempest-VolumesDeleteCascade-749329031 None] Created volume successfully.
Nov 05 12:06:00 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793" returned: 0 in 0.422s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8142137c-1759-494a-ab49-9554289dc246]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:00 devstack sudo[100421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8
Nov 05 12:06:00 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:00 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" returned: 0 in 0.385s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:00 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793
Nov 05 12:06:00 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:00 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793" returned: 0 in 0.427s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:00 devstack sudo[100431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793
Nov 05 12:06:00 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Creating offline snapshot ba757cdf-c59c-400d-b68c-630c404374f2 of volume 382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f289da-ed0b-454d-b80c-c8c2b95fa651]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:01 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8.f297e91c-3363-49fa-9907-13bda3c32793" returned: 0 in 0.346s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:01 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e
Nov 05 12:06:01 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-f297e91c-3363-49fa-9907-13bda3c32793" released by "_delete_snapshot" :: held 1.770s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" released by "delete_snapshot" :: held 1.795s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:01 devstack cinder-volume[87317]: WARNING cinder.quota [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-975607370 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-975607370, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:01 devstack cinder-volume[87317]: WARNING cinder.quota [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-975607370 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-975607370, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] Created reservations ['6facbfeb-f288-4adb-915e-33065640b22d', 'b2e997a0-58c9-4460-af74-f03d62930de0', 'fcfcb757-8914-49f9-ad25-9155a9aaad8a', '822ed3dc-4980-4004-a965-bb5d63d2824d'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e77733cc-accf-49a9-a7f3-d927b9dcb2fa tempest-GroupSnapshotsTest-11402096 None] group_snapshot a5600912-9e41-4c71-86bb-7e7f95b70142: deleted successfully
Nov 05 12:06:01 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e" returned: 0 in 0.454s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:01 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 1G
Nov 05 12:06:01 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 1G" returned: 0 in 0.600s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382a62b4-9528-4d10-b90e-70fc3275319e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "cinder-quobyte-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:02 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382a62b4-9528-4d10-b90e-70fc3275319e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2
Nov 05 12:06:02 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3cdfa3-291e-48c4-be56-1242cf753998]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:02 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8
Nov 05 12:06:02 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382a62b4-9528-4d10-b90e-70fc3275319e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2" returned: 0 in 0.327s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:02 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 is being set with open permissions: ugo+rw
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:02 devstack sudo[100453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2
Nov 05 12:06:02 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" returned: 0 in 0.399s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:02 devstack sudo[100458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8
Nov 05 12:06:02 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:02 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.info
Nov 05 12:06:02 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:02 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" returned: 0 in 0.268s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Lock "cinder-quobyte-b37b4c6d-f9ff-4b01-a35c-92c7a9ae7bd8" released by "delete_volume" :: held 0.762s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Created reservations ['b2a66f8a-d281-4521-9719-988ddbc2d3fd'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:03 devstack cinder-volume[87317]: WARNING cinder.quota [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-975607370 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-975607370, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Created reservations ['921ab46a-d2ec-4c32-b228-a33a7f1ddeba', '364e880d-5298-4776-8b22-5a8bf46e4154', '43bff7cf-280c-41a0-bc76-28f647eb487d', 'dd8efc2b-03c8-4dc9-9965-8db84401bcf6'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:03 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.info" returned: 0 in 0.358s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:03 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.info is being set with open permissions: ugo+rw
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:03 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.info
Nov 05 12:06:03 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:03 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:03 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:03 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.info" returned: 0 in 0.283s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:03 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:03 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-23ffbe6c-1293-4596-a4a1-6eb8c68057fb tempest-GroupSnapshotsTest-11402096 None] Delete group completed successfully.
Nov 05 12:06:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2a939894-e365-45f7-9bdc-fa3d393a5acf tempest-VolumesDeleteCascade-749329031 None] Create snapshot completed successfully
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Creating offline snapshot 3503bc9e-bfe8-4d7d-9097-d91346e676ea of volume 382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfbed0c-d1e0-4119-b64d-2987dacd0c21]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2
Nov 05 12:06:04 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:04 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2" returned: 0 in 0.424s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382a62b4-9528-4d10-b90e-70fc3275319e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:04 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea 1G
Nov 05 12:06:04 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:05 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea 1G" returned: 0 in 0.640s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:05 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea
Nov 05 12:06:05 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:05 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea" returned: 0 in 0.387s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:05 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea is being set with open permissions: ugo+rw
Nov 05 12:06:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:06 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea
Nov 05 12:06:06 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:06 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d7bcc243-e205-415b-8cd7-4a8d4ef0d597 tempest-VolumesDeleteCascade-749329031 None] Create snapshot completed successfully
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-382a62b4-9528-4d10-b90e-70fc3275319e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-382a62b4-9528-4d10-b90e-70fc3275319e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Performing cascade delete. {{(pid=87317) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-3503bc9e-bfe8-4d7d-9097-d91346e676ea-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-3503bc9e-bfe8-4d7d-9097-d91346e676ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-3503bc9e-bfe8-4d7d-9097-d91346e676ea" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-3503bc9e-bfe8-4d7d-9097-d91346e676ea" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Deleting offline snapshot 3503bc9e-bfe8-4d7d-9097-d91346e676ea of volume 382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] snapshot_file for this snap is: volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fd1ae0-ea4f-400a-88cb-54b73154f17f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:07 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea
Nov 05 12:06:07 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:07 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea" returned: 0 in 0.486s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382a62b4-9528-4d10-b90e-70fc3275319e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5717b5-bdc0-4e5a-80f1-a5602e17528f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:07 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2
Nov 05 12:06:07 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:07 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2" returned: 0 in 0.495s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382a62b4-9528-4d10-b90e-70fc3275319e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:07 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea
Nov 05 12:06:07 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:08 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea" returned: 0 in 0.516s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:08 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea
Nov 05 12:06:08 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:08 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.3503bc9e-bfe8-4d7d-9097-d91346e676ea" returned: 0 in 0.324s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-3503bc9e-bfe8-4d7d-9097-d91346e676ea" released by "_delete_snapshot" :: held 1.966s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" released by "delete_snapshot" :: held 1.994s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Created reservations ['9fd328c3-be21-4ce9-b071-7e5f56c4b7b7', 'abee1a8f-926e-480c-a69a-1434dfed1462', '6beab593-527b-49fa-99a3-4730b359207e', '979e297a-80a2-4fe1-a258-0e0120d86723'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:08 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Delete snapshot completed successfully.
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-3503bc9e-bfe8-4d7d-9097-d91346e676ea-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-ba757cdf-c59c-400d-b68c-630c404374f2-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-ba757cdf-c59c-400d-b68c-630c404374f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-ba757cdf-c59c-400d-b68c-630c404374f2" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-ba757cdf-c59c-400d-b68c-630c404374f2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Deleting offline snapshot ba757cdf-c59c-400d-b68c-630c404374f2 of volume 382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] snapshot_file for this snap is: volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc97dd39-6bf9-489a-a5e2-ad0875a1bfa7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:09 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2
Nov 05 12:06:09 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:09 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2" returned: 0 in 0.399s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382a62b4-9528-4d10-b90e-70fc3275319e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac9bb6-316e-4f8b-b98e-55717f792328]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:09 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e
Nov 05 12:06:09 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:10 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e" returned: 0 in 0.439s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:10 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2
Nov 05 12:06:10 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:10 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2" returned: 0 in 0.397s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:10 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2
Nov 05 12:06:10 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:10 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e.ba757cdf-c59c-400d-b68c-630c404374f2" returned: 0 in 0.310s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-ba757cdf-c59c-400d-b68c-630c404374f2" released by "_delete_snapshot" :: held 1.684s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" released by "delete_snapshot" :: held 1.718s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Created reservations ['7db2d09b-bdf6-402c-9c3b-6094c55485f8', 'f9638f97-d12c-4008-8b45-34040d6a22be', 'ca5c9e83-3076-49b2-91ca-8c9ae01dc66e', '16e3e4c2-8030-4055-8bd4-27f4a1904ce9'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:10 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Delete snapshot completed successfully.
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-ba757cdf-c59c-400d-b68c-630c404374f2-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Snapshots deleted, issuing volume delete {{(pid=87317) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d75cad-a8cb-4e46-a7f1-32a9814fe6e0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:11 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e
Nov 05 12:06:11 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-072d3d58-4d13-4c96-ab6d-7a6b7a5ca2e2 tempest-GroupSnapshotsV319Test-1564959993 None] Group tempest-GroupSnapshotsV319Test-Group-947069013: creating
Nov 05 12:06:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-072d3d58-4d13-4c96-ab6d-7a6b7a5ca2e2 tempest-GroupSnapshotsV319Test-1564959993 None] Group tempest-GroupSnapshotsV319Test-Group-947069013: created successfully
Nov 05 12:06:11 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-072d3d58-4d13-4c96-ab6d-7a6b7a5ca2e2 tempest-GroupSnapshotsV319Test-1564959993 None] Create group completed successfully.
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e" returned: 0 in 0.470s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:11 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e
Nov 05 12:06:11 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:11 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-382a62b4-9528-4d10-b90e-70fc3275319e" returned: 0 in 0.261s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-382a62b4-9528-4d10-b90e-70fc3275319e" released by "delete_volume" :: held 0.812s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Created reservations ['41366a0e-4c30-4872-8cb7-a7964a59f89e', '3f64b318-2230-4e63-89b7-3a1d5081679e', 'e530fd41-7850-41b3-8a5b-e5a01e274a4a', '80d1768d-fa68-4102-95b1-644536e53169'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:11 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:11 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:12 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:12 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:12 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Deleted volume successfully.
Nov 05 12:06:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6f5dcd34-f91c-41bb-ba98-f7326f60bcc7 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-382a62b4-9528-4d10-b90e-70fc3275319e-delete_volume" released by "delete_volume" :: held 5.544s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:12 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:12 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Flow 'volume_create_manager' (12d3f90b-3e84-4bcf-9361-cef53e9c470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:12 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c01a52-1c59-4766-b888-3ac3bef0b3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c01a52-1c59-4766-b888-3ac3bef0b3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-293662474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f693688f-6a2c-4358-8b33-28d59f344ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db486c2d94c14f35a63e8b46f214a65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='626ec404942149808232d71547da03a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e583e4e8-1a73-477c-bb6f-d53de8a23a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e583e4e8-1a73-477c-bb6f-d53de8a23a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4710785a-72f1-43bf-ac68-d2ecaff68492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4710785a-72f1-43bf-ac68-d2ecaff68492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f693688f-6a2c-4358-8b33-28d59f344ed8', 'volume_name': 'volume-f693688f-6a2c-4358-8b33-28d59f344ed8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f64bf8-f688-4a75-a99f-9d61b80ed381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f64bf8-f688-4a75-a99f-9d61b80ed381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e54b626-67fb-42a8-8c2d-af944f3069ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Volume f693688f-6a2c-4358-8b33-28d59f344ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f693688f-6a2c-4358-8b33-28d59f344ed8', 'volume_size': 1}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-293662474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f693688f-6a2c-4358-8b33-28d59f344ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db486c2d94c14f35a63e8b46f214a65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='626ec404942149808232d71547da03a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Creating volume f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:13 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:13 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 1073741824
Nov 05 12:06:13 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Flow 'volume_create_manager' (ca0de640-3d57-40c5-aae9-23b311f19580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4dc09-4036-47b6-bed7-5547ee7f9fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4dc09-4036-47b6-bed7-5547ee7f9fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315535252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=760f1773-0271-4b98-8f89-8d13360b886a,host='devstack@QuobyteHD#QuobyteHD',id=8eba444a-c3e8-4305-889d-3d2261881941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2733a8c8d1e4bbf8f0097bc20985827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='4b5520ea48934eaea62dad24d08ce9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdd2d7c2-ddf5-4758-a29f-83fcaca29fa6),volume_type_id=bdd2d7c2-ddf5-4758-a29f-83fcaca29fa6)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96657f9-4f62-41cb-a15b-849ce2ecf213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96657f9-4f62-41cb-a15b-849ce2ecf213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d45e23-a53f-4b4c-95d4-716ed893c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d45e23-a53f-4b4c-95d4-716ed893c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eba444a-c3e8-4305-889d-3d2261881941', 'volume_name': 'volume-8eba444a-c3e8-4305-889d-3d2261881941', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bbbaf37-8cf8-4bbe-8e6d-4642a10cb8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bbbaf37-8cf8-4bbe-8e6d-4642a10cb8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9cf6e9-9a8c-40b5-93e9-3bfe6eb5f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:13 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Volume 8eba444a-c3e8-4305-889d-3d2261881941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eba444a-c3e8-4305-889d-3d2261881941', 'volume_size': 1}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:13 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 1073741824" returned: 0 in 0.506s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:13 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8
Nov 05 12:06:13 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:13 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:13 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8" returned: 0 in 0.301s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=760f1773-0271-4b98-8f89-8d13360b886a,created_at=2026-11-05T11:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315535252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=760f1773-0271-4b98-8f89-8d13360b886a,host='devstack@QuobyteHD#QuobyteHD',id=8eba444a-c3e8-4305-889d-3d2261881941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2733a8c8d1e4bbf8f0097bc20985827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:13Z,use_quota=True,user_id='4b5520ea48934eaea62dad24d08ce9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdd2d7c2-ddf5-4758-a29f-83fcaca29fa6),volume_type_id=bdd2d7c2-ddf5-4758-a29f-83fcaca29fa6)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Creating volume 8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:13 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e54b626-67fb-42a8-8c2d-af944f3069ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f693688f-6a2c-4358-8b33-28d59f344ed8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:13 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 1073741824
Nov 05 12:06:13 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d5874-ebe1-46a3-a490-cfcd09814304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:14 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Volume volume-f693688f-6a2c-4358-8b33-28d59f344ed8 (f693688f-6a2c-4358-8b33-28d59f344ed8): created successfully
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d5874-ebe1-46a3-a490-cfcd09814304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Flow 'volume_create_manager' (12d3f90b-3e84-4bcf-9361-cef53e9c470a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:14 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e3b6fb23-963a-46a7-8fea-e50b94880c4e tempest-VolumesDeleteCascade-749329031 None] Created volume successfully.
Nov 05 12:06:14 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 1073741824" returned: 0 in 0.499s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:14 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941
Nov 05 12:06:14 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:14 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9cf6e9-9a8c-40b5-93e9-3bfe6eb5f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eba444a-c3e8-4305-889d-3d2261881941', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af63c10e-012c-46c0-8b31-5e1d9a427105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:14 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Volume volume-8eba444a-c3e8-4305-889d-3d2261881941 (8eba444a-c3e8-4305-889d-3d2261881941): created successfully
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af63c10e-012c-46c0-8b31-5e1d9a427105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Flow 'volume_create_manager' (ca0de640-3d57-40c5-aae9-23b311f19580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:14 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8c2b8c03-f2ae-45eb-83ef-9f37c8d71fe9 tempest-GroupSnapshotsV319Test-1564959993 None] Created volume successfully.
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Creating offline snapshot fe8111d3-5e6e-4112-b0fd-16ce6fd50557 of volume f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8f92d-e052-4a60-ab5e-9594669c7703]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:15 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8
Nov 05 12:06:15 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Flow 'volume_create_manager' (75b5b235-e625-4575-9e13-58c963da62f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec76f9a-802f-4698-9d94-66d0914b2c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec76f9a-802f-4698-9d94-66d0914b2c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a3d6c8-93c9-47a6-9e2a-d686f54db0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d1bd0415254952bf115fb85f0903e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:15Z,use_quota=True,user_id='584195727afc4c8f9f3cf383b8f78cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae08e252-5d80-41e3-a9a5-57bc8f981273),volume_type_id=ae08e252-5d80-41e3-a9a5-57bc8f981273)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37613f90-c011-430b-a546-8bf6f61ac88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37613f90-c011-430b-a546-8bf6f61ac88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635f59e1-759e-472f-b9fe-f28ebfba2793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:06:15 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8" returned: 0 in 0.447s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:15 devstack sudo[100607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 1G
Nov 05 12:06:15 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635f59e1-759e-472f-b9fe-f28ebfba2793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44a3d6c8-93c9-47a6-9e2a-d686f54db0cd', 'volume_name': 'volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd', 'volume_size': 1, 'image_id': '3753a612-37f4-4961-af36-923585261a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3753a612-37f4-4961-af36-923585261a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81ce2cf274c4b98e0d3e761f53d089ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f8d1bd0415254952bf115fb85f0903e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6774777ccfbe82af4d22a3e7e402281fb419e747a7584bb1293c7390d114dc28863aa2117d02a134f5bed6fa61dfafb1bc776d07532a6ff0c1d09335ed545622', 'id': '3753a612-37f4-4961-af36-923585261a79', 'created_at': datetime.datetime(2026, 11, 5, 11, 6, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3753a612-37f4-4961-af36-923585261a79/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01ea55190>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64f425d-bb22-4231-b80f-f8bf7a170c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64f425d-bb22-4231-b80f-f8bf7a170c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dcf414-2e9b-4c9c-a8ac-330143535c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:15 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Volume 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd', 'volume_size': 1, 'image_id': '3753a612-37f4-4961-af36-923585261a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3753a612-37f4-4961-af36-923585261a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81ce2cf274c4b98e0d3e761f53d089ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f8d1bd0415254952bf115fb85f0903e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6774777ccfbe82af4d22a3e7e402281fb419e747a7584bb1293c7390d114dc28863aa2117d02a134f5bed6fa61dfafb1bc776d07532a6ff0c1d09335ed545622', 'id': '3753a612-37f4-4961-af36-923585261a79', 'created_at': datetime.datetime(2026, 11, 5, 11, 6, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3753a612-37f4-4961-af36-923585261a79/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01ea55190>}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Trying to clone 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd from image 3753a612-37f4-4961-af36-923585261a79 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3753a612-37f4-4961-af36-923585261a79', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:06:15 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] GroupSnapshot 67d946c3-7fc2-43f6-8511-a90de670babe: creating.
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:06:15 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Group snapshot 67d946c3-7fc2-43f6-8511-a90de670babe: creating. {{(pid=87317) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 12:06:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb989c3-08d1-41c5-9393-8407da4530ea]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack sudo[100611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD
Nov 05 12:06:16 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:16 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 1G" returned: 0 in 0.484s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f693688f-6a2c-4358-8b33-28d59f344ed8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f693688f-6a2c-4358-8b33-28d59f344ed8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557
Nov 05 12:06:16 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:16 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack sudo[100618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD
Nov 05 12:06:16 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:16 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f693688f-6a2c-4358-8b33-28d59f344ed8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557" returned: 0 in 0.315s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:16 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 is being set with open permissions: ugo+rw
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557
Nov 05 12:06:16 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:16 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Temporary image 3753a612-37f4-4961-af36-923585261a79 is fetched for user 584195727afc4c8f9f3cf383b8f78cc9. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:06:16 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8a7884-a7ff-4e61-8911-21583243bcae]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:16 devstack sudo[100630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.info
Nov 05 12:06:16 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:16 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD
Nov 05 12:06:16 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:17 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.info" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:17 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.info is being set with open permissions: ugo+rw
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:17 devstack sudo[100634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.info
Nov 05 12:06:17 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:17 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:17 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD
Nov 05 12:06:17 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:17 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.info" returned: 0 in 0.271s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.460s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Creating offline snapshot 030d24d9-3b85-440d-bed8-7616b3dc29eb of volume 8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:06:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-feae35b9-20df-48bb-abdf-9b898559cb4a tempest-VolumesDeleteCascade-749329031 None] Create snapshot completed successfully
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc166cb0-4c11-4705-85fc-4242a63c3a81]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:17 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:17 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941
Nov 05 12:06:17 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:17 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941" returned: 0 in 0.385s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:17 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb 1G
Nov 05 12:06:17 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:18 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb 1G" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eba444a-c3e8-4305-889d-3d2261881941 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:18 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eba444a-c3e8-4305-889d-3d2261881941 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb
Nov 05 12:06:18 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:18 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eba444a-c3e8-4305-889d-3d2261881941 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb" returned: 0 in 0.308s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:18 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:06:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:18 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb
Nov 05 12:06:18 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:18 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:18 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.info
Nov 05 12:06:18 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Flow 'volume_create_manager' (bc6d9920-3334-4b2b-b959-f04f0cd3731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcf0bbb-362a-42ef-ab23-dd3d75845d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcf0bbb-362a-42ef-ab23-dd3d75845d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1374215624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c1bad1-1442-423f-90db-886e84552e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db486c2d94c14f35a63e8b46f214a65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe8111d3-5e6e-4112-b0fd-16ce6fd50557,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:19Z,use_quota=True,user_id='626ec404942149808232d71547da03a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3431d3-5826-49f1-bc7f-235a897f481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3431d3-5826-49f1-bc7f-235a897f481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66324dc-3758-487a-bb86-d1cbaf5b821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66324dc-3758-487a-bb86-d1cbaf5b821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5c1bad1-1442-423f-90db-886e84552e77', 'volume_name': 'volume-c5c1bad1-1442-423f-90db-886e84552e77', 'volume_size': 1, 'snapshot_id': 'fe8111d3-5e6e-4112-b0fd-16ce6fd50557'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91482ca4-08bd-4b62-a033-b5fb0ad4112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91482ca4-08bd-4b62-a033-b5fb0ad4112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9b7018-e818-4b0a-9c8d-945bf768f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:19 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Volume c5c1bad1-1442-423f-90db-886e84552e77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5c1bad1-1442-423f-90db-886e84552e77', 'volume_size': 1, 'snapshot_id': 'fe8111d3-5e6e-4112-b0fd-16ce6fd50557'}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:19 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.info" returned: 0 in 0.284s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:19 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:19 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.info
Nov 05 12:06:19 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:19 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.info" returned: 0 in 0.253s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.880s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a3d6c8-93c9-47a6-9e2a-d686f54db0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d1bd0415254952bf115fb85f0903e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:15Z,use_quota=True,user_id='584195727afc4c8f9f3cf383b8f78cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae08e252-5d80-41e3-a9a5-57bc8f981273),volume_type_id=ae08e252-5d80-41e3-a9a5-57bc8f981273)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Creating volume 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:19 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:19 devstack sudo[100669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd 1073741824
Nov 05 12:06:19 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:19 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-305a89e1-6160-4a84-a27b-9a95e9ecc2c3 tempest-GroupSnapshotsV319Test-1564959993 None] group_snapshot 67d946c3-7fc2-43f6-8511-a90de670babe: created successfully
Nov 05 12:06:19 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd 1073741824" returned: 0 in 0.478s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:20 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd
Nov 05 12:06:20 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:20 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.180s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-fe8111d3-5e6e-4112-b0fd-16ce6fd50557-c5c1bad1-1442-423f-90db-886e84552e77" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-fe8111d3-5e6e-4112-b0fd-16ce6fd50557-c5c1bad1-1442-423f-90db-886e84552e77" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Creating volume c5c1bad1-1442-423f-90db-886e84552e77 from snapshot fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-c5c1bad1-1442-423f-90db-886e84552e77" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Attempting download of 3753a612-37f4-4961-af36-923585261a79 ((None, [{'url': 'file:///opt/stack/data/glance/images/3753a612-37f4-4961-af36-923585261a79', 'metadata': {}}])) to volume 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-c5c1bad1-1442-423f-90db-886e84552e77" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] snapshot: fe8111d3-5e6e-4112-b0fd-16ce6fd50557, volume: c5c1bad1-1442-423f-90db-886e84552e77,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[39da6d4c-dfe1-49a8-b5ae-1eba6843bc45]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51d200-8f56-4aaa-9d0c-8afd51909379]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3753a612-37f4-4961-af36-923585261a79_9klswtrf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:20 devstack sudo[100677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557
Nov 05 12:06:20 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:20 devstack sudo[100678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3753a612-37f4-4961-af36-923585261a79_9klswtrf
Nov 05 12:06:20 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:20 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3753a612-37f4-4961-af36-923585261a79_9klswtrf" returned: 0 in 0.407s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3753a612-37f4-4961-af36-923585261a79_9klswtrf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:20 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] group_snapshot 67d946c3-7fc2-43f6-8511-a90de670babe: deleting
Nov 05 12:06:20 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557" returned: 0 in 0.505s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f693688f-6a2c-4358-8b33-28d59f344ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:21 devstack sudo[100687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3753a612-37f4-4961-af36-923585261a79_9klswtrf
Nov 05 12:06:21 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3894f421-694a-4e87-9cd5-7a87589d4f8c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] group_snapshot 67d946c3-7fc2-43f6-8511-a90de670babe: deleting {{(pid=87317) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Acquiring lock "cinder-quobyte-8eba444a-c3e8-4305-889d-3d2261881941" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "cinder-quobyte-8eba444a-c3e8-4305-889d-3d2261881941" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Acquiring lock "cinder-quobyte-030d24d9-3b85-440d-bed8-7616b3dc29eb" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "cinder-quobyte-030d24d9-3b85-440d-bed8-7616b3dc29eb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Deleting offline snapshot 030d24d9-3b85-440d-bed8-7616b3dc29eb of volume 8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] snapshot_file for this snap is: volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea72c5-3521-45bb-a5c5-054eb3861f22]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:21 devstack sudo[100689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8
Nov 05 12:06:21 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:21 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3753a612-37f4-4961-af36-923585261a79_9klswtrf" returned: 1 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3753a612-37f4-4961-af36-923585261a79_9klswtrf' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e97bef5-ee07-4982-88b0-fa8819d798bf]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:21 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb
Nov 05 12:06:21 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:21 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD
Nov 05 12:06:21 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:21 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8" returned: 0 in 0.461s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:21 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77
Nov 05 12:06:21 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:21 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb" returned: 0 in 0.420s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eba444a-c3e8-4305-889d-3d2261881941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1eaf56-7491-4408-aef8-d9df7a381b40]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:21 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:21 devstack sudo[100707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941
Nov 05 12:06:21 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:21 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD
Nov 05 12:06:21 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:22 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941" returned: 0 in 0.516s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:22 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD" returned: 1 in 0.527s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:06:22 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] 3753a612-37f4-4961-af36-923585261a79 was raw, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:06:22 devstack sudo[100727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb
Nov 05 12:06:22 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:22 devstack sudo[100729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd
Nov 05 12:06:22 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:22 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb" returned: 0 in 0.812s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:23 devstack sudo[100738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb
Nov 05 12:06:23 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:23 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941.030d24d9-3b85-440d-bed8-7616b3dc29eb" returned: 0 in 0.527s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:23 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd" returned: 0 in 1.362s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3753a612-37f4-4961-af36-923585261a79_0d90uf09devstack@QuobyteHD, size 0.00 MB, duration 1.36 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:06:23 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "cinder-quobyte-030d24d9-3b85-440d-bed8-7616b3dc29eb" released by "_delete_snapshot" :: held 2.471s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Lock "cinder-quobyte-8eba444a-c3e8-4305-889d-3d2261881941" released by "delete_snapshot" :: held 2.512s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:23 devstack sudo[100743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd 1G
Nov 05 12:06:23 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:23 devstack cinder-volume[87317]: WARNING cinder.quota [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-618714128 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-618714128, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:23 devstack cinder-volume[87317]: WARNING cinder.quota [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-618714128 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-618714128, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:23 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] Created reservations ['57c615ac-61c4-4d9a-915b-9f8f2f8b0948', '3361dbb5-9bc8-41c5-a461-1fcce7f944d0', 'be1e3b82-9619-4cd5-b364-1dc85c185332', 'fbb23db6-7289-49ce-b457-55483286f391'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8b1b7524-4752-46a8-8127-cc12c97ebd60 tempest-GroupSnapshotsV319Test-1564959993 None] group_snapshot 67d946c3-7fc2-43f6-8511-a90de670babe: deleted successfully
Nov 05 12:06:24 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd 1G" returned: 0 in 0.912s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Downloaded image 3753a612-37f4-4961-af36-923585261a79 ((None, [{'url': 'file:///opt/stack/data/glance/images/3753a612-37f4-4961-af36-923585261a79', 'metadata': {}}])) to volume 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Temporary image 3753a612-37f4-4961-af36-923585261a79 for user 584195727afc4c8f9f3cf383b8f78cc9 is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Marking volume 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Copying metadata from image 3753a612-37f4-4961-af36-923585261a79 to 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Creating volume glance metadata for volume 44a3d6c8-93c9-47a6-9e2a-d686f54db0cd backed by image 3753a612-37f4-4961-af36-923585261a79 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3753a612-37f4-4961-af36-923585261a79', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '81ce2cf274c4b98e0d3e761f53d089ff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dcf414-2e9b-4c9c-a8ac-330143535c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd', 'volume_size': 1, 'image_id': '3753a612-37f4-4961-af36-923585261a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3753a612-37f4-4961-af36-923585261a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81ce2cf274c4b98e0d3e761f53d089ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f8d1bd0415254952bf115fb85f0903e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6774777ccfbe82af4d22a3e7e402281fb419e747a7584bb1293c7390d114dc28863aa2117d02a134f5bed6fa61dfafb1bc776d07532a6ff0c1d09335ed545622', 'id': '3753a612-37f4-4961-af36-923585261a79', 'created_at': datetime.datetime(2026, 11, 5, 11, 6, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3753a612-37f4-4961-af36-923585261a79/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01ea55190>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c246d4-50ef-4dad-b8a6-11170c6a67c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:24 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Volume volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd (44a3d6c8-93c9-47a6-9e2a-d686f54db0cd): created successfully
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c246d4-50ef-4dad-b8a6-11170c6a67c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Flow 'volume_create_manager' (75b5b235-e625-4575-9e13-58c963da62f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-13cf0668-4abc-4d93-aafb-e7ee08d86ec6 tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Created volume successfully.
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Acquiring lock "cinder-quobyte-8eba444a-c3e8-4305-889d-3d2261881941" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Lock "cinder-quobyte-8eba444a-c3e8-4305-889d-3d2261881941" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92a6b5c-2c0e-486a-bc89-d9c3cfc1ed32]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:25 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941
Nov 05 12:06:25 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Acquiring lock "cinder-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "cinder-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Acquiring lock "cinder-quobyte-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "cinder-quobyte-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[214e4bab-dd20-4268-86a9-d81d35cd6e2c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:25 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd
Nov 05 12:06:25 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:26 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941" returned: 0 in 0.816s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:26 devstack sudo[100757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941
Nov 05 12:06:26 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:26 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd" returned: 0 in 0.653s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:26 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8eba444a-c3e8-4305-889d-3d2261881941" returned: 0 in 0.474s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:26 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd
Nov 05 12:06:26 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Lock "cinder-quobyte-8eba444a-c3e8-4305-889d-3d2261881941" released by "delete_volume" :: held 1.456s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Created reservations ['ea75344a-a01e-4530-8d26-af183ea3f977'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:26 devstack cinder-volume[87317]: WARNING cinder.quota [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-618714128 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-618714128, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:26 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Created reservations ['f9b3060c-0d20-4771-9f59-f0c41b16d872', '25c8ae86-2588-43ce-a13a-0462166c016d', '7d9cf839-9391-4ef9-b331-5f42122ca2d1', 'a3c04dc4-6b61-4918-af18-958c92877a9e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:27 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd" returned: 0 in 0.668s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:27 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:27 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "cinder-quobyte-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd" released by "delete_volume" :: held 1.458s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:27 devstack cinder-volume[87317]: WARNING cinder.quota [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:27 devstack cinder-volume[87317]: WARNING cinder.quota [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Created reservations ['7136b007-70ad-45e3-b944-f9c13e0c7cd5', 'feefa92f-9e48-412a-b99e-25f0dcec681d', 'f20c9113-692f-49a2-9c7d-fa958f688639', 'd0228fbd-6510-47c6-ab47-56bfe6eb62ee'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:27 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.509s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:27 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:27 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:27 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4812fad3-dd9f-4d10-9af4-b484e7f4ae3f tempest-GroupSnapshotsV319Test-1564959993 None] Delete group completed successfully.
Nov 05 12:06:28 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.518s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:28 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Deleted volume successfully.
Nov 05 12:06:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5720f63d-de46-4fd6-bcf2-cf4a1b34407f tempest-VolumeAndVolumeTypeFromImageTest-298081746 None] Lock "cinder-44a3d6c8-93c9-47a6-9e2a-d686f54db0cd-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:29 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77" returned: 0 in 8.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:29 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:06:29 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Converted 1024.00 MB image at 121.92 MB/s
Nov 05 12:06:29 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77 is being set with open permissions: ugo+rw
Nov 05 12:06:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:29 devstack sudo[100772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77
Nov 05 12:06:29 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:30 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77" returned: 0 in 0.303s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-c5c1bad1-1442-423f-90db-886e84552e77" released by "_copy_volume_from_snapshot" :: held 9.858s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-fe8111d3-5e6e-4112-b0fd-16ce6fd50557-c5c1bad1-1442-423f-90db-886e84552e77" released by "_create_volume_from_snapshot" :: held 9.946s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.976s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9b7018-e818-4b0a-9c8d-945bf768f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c1bad1-1442-423f-90db-886e84552e77', 'volume_size': 1, 'snapshot_id': 'fe8111d3-5e6e-4112-b0fd-16ce6fd50557'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2560419d-c365-49d1-9e3e-41a4b4db7e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Volume volume-c5c1bad1-1442-423f-90db-886e84552e77 (c5c1bad1-1442-423f-90db-886e84552e77): created successfully
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2560419d-c365-49d1-9e3e-41a4b4db7e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Flow 'volume_create_manager' (bc6d9920-3334-4b2b-b959-f04f0cd3731f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e80e2896-055f-4cf7-a713-eeba43a08655 tempest-VolumesDeleteCascade-749329031 None] Created volume successfully.
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-f693688f-6a2c-4358-8b33-28d59f344ed8-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-f693688f-6a2c-4358-8b33-28d59f344ed8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Performing cascade delete. {{(pid=87317) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-fe8111d3-5e6e-4112-b0fd-16ce6fd50557-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-fe8111d3-5e6e-4112-b0fd-16ce6fd50557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-f693688f-6a2c-4358-8b33-28d59f344ed8" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-f693688f-6a2c-4358-8b33-28d59f344ed8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-fe8111d3-5e6e-4112-b0fd-16ce6fd50557" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-fe8111d3-5e6e-4112-b0fd-16ce6fd50557" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Deleting offline snapshot fe8111d3-5e6e-4112-b0fd-16ce6fd50557 of volume f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] snapshot_file for this snap is: volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb2e231-407d-4b59-9a19-2544e4d81c62]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:31 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557
Nov 05 12:06:31 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:32 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557" returned: 0 in 0.465s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f693688f-6a2c-4358-8b33-28d59f344ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:06:32 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a057f-bf02-43fb-97fc-5bee1a3a3332]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:32 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8
Nov 05 12:06:32 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:32 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8" returned: 0 in 0.653s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:32 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557
Nov 05 12:06:32 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:33 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557" returned: 0 in 0.422s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:33 devstack sudo[100790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557
Nov 05 12:06:33 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:33 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8.fe8111d3-5e6e-4112-b0fd-16ce6fd50557" returned: 0 in 0.292s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-fe8111d3-5e6e-4112-b0fd-16ce6fd50557" released by "_delete_snapshot" :: held 1.968s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-f693688f-6a2c-4358-8b33-28d59f344ed8" released by "delete_snapshot" :: held 1.994s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Created reservations ['a5bc1ac7-02da-4b27-acb5-5a861bf377fa', 'b2e9b493-d6fc-4824-b9da-ae7694a8bddb', 'f094a199-d316-494d-a20c-b5469b2317db', 'fdc47528-9ad4-44d7-884e-336f202f1dd0'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Delete snapshot completed successfully.
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-fe8111d3-5e6e-4112-b0fd-16ce6fd50557-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Snapshots deleted, issuing volume delete {{(pid=87317) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-f693688f-6a2c-4358-8b33-28d59f344ed8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-f693688f-6a2c-4358-8b33-28d59f344ed8" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce80682b-f942-4c33-befc-29ee178bc49d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:33 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8
Nov 05 12:06:33 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:34 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8" returned: 0 in 0.416s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:34 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8
Nov 05 12:06:34 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:34 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f693688f-6a2c-4358-8b33-28d59f344ed8" returned: 0 in 0.301s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-f693688f-6a2c-4358-8b33-28d59f344ed8" released by "delete_volume" :: held 0.803s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Created reservations ['7843c8d9-dae8-4e2b-96ba-2a6cc6bfe515', '8083b0a1-f206-4b46-a9e9-04e429b8ab55', '83625610-de77-419a-a2b5-da4caf13e0da', '879e3757-7014-4554-8d17-6cb4be7a9ccb'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (c70db86d-72c5-4c5e-9ba6-aa2a2d91469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308fcf9b-0120-4782-a7f4-15e0248a75b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308fcf9b-0120-4782-a7f4-15e0248a75b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1313782132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d34dda-843a-4356-9624-ba4f9faf02b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:35Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:34 devstack sudo[100803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:34 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273b6bf2-2afc-4ee9-80ca-a6f13c9a5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273b6bf2-2afc-4ee9-80ca-a6f13c9a5e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28ddff6-c3fb-493a-8593-fc58a0bb3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28ddff6-c3fb-493a-8593-fc58a0bb3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d34dda-843a-4356-9624-ba4f9faf02b3', 'volume_name': 'volume-c0d34dda-843a-4356-9624-ba4f9faf02b3', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887870e8-90a4-4f6e-95bb-5c25de103df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887870e8-90a4-4f6e-95bb-5c25de103df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2af7745-5567-4a0f-8e69-fbfb35e06dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Volume c0d34dda-843a-4356-9624-ba4f9faf02b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d34dda-843a-4356-9624-ba4f9faf02b3', 'volume_size': 1}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1313782132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d34dda-843a-4356-9624-ba4f9faf02b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:35Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Creating volume c0d34dda-843a-4356-9624-ba4f9faf02b3 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:34 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:34 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3 1073741824
Nov 05 12:06:34 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-c5c1bad1-1442-423f-90db-886e84552e77-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-c5c1bad1-1442-423f-90db-886e84552e77-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "cinder-quobyte-c5c1bad1-1442-423f-90db-886e84552e77" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-c5c1bad1-1442-423f-90db-886e84552e77" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d593e08a-569b-4551-84b7-48f8321c6a83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:35 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.506s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Deleted volume successfully.
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2137562f-72f1-4a9a-b44b-8a080cf2e7bc tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-f693688f-6a2c-4358-8b33-28d59f344ed8-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (2d522f41-77b3-40b8-977e-e588604f7340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b48cd9-3e47-4c8c-b6f5-9facff3bbb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b48cd9-3e47-4c8c-b6f5-9facff3bbb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1144953095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c41be58-83f2-45e4-b090-c0c2e14595f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:35Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf6a914-cbfc-4ce7-8679-b4902c171aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf6a914-cbfc-4ce7-8679-b4902c171aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713c128b-8d38-4ae6-965a-4acb72b4f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713c128b-8d38-4ae6-965a-4acb72b4f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c41be58-83f2-45e4-b090-c0c2e14595f6', 'volume_name': 'volume-5c41be58-83f2-45e4-b090-c0c2e14595f6', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:35 devstack sudo[100810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77
Nov 05 12:06:35 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1300287-bb2b-428e-9696-fe09341140da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1300287-bb2b-428e-9696-fe09341140da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb5378b-b6b1-4523-bea0-86d0f5846437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:35 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Volume 5c41be58-83f2-45e4-b090-c0c2e14595f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c41be58-83f2-45e4-b090-c0c2e14595f6', 'volume_size': 1}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:35 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3 1073741824" returned: 0 in 0.745s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:35 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3
Nov 05 12:06:35 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (fd5f9c79-ce59-4e11-a6c7-cbd1babe73b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99975453-90fe-4712-96b5-8e02feba4bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77" returned: 0 in 0.787s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99975453-90fe-4712-96b5-8e02feba4bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1423169659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d640a97-17b3-4f4e-a70b-bd26ebcc40a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:36Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac55edf1-5ab0-4f53-9fde-9b51cb0fd101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac55edf1-5ab0-4f53-9fde-9b51cb0fd101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c5c890-d77a-4b26-92a3-7e7788bf4653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c5c890-d77a-4b26-92a3-7e7788bf4653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d640a97-17b3-4f4e-a70b-bd26ebcc40a7', 'volume_name': 'volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77
Nov 05 12:06:36 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c50fedb-d112-4212-b0d6-7bf190241089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c50fedb-d112-4212-b0d6-7bf190241089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34e9f68-7397-4c6f-871f-d91572c0af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:36 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Volume 4d640a97-17b3-4f4e-a70b-bd26ebcc40a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7', 'volume_size': 1}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3" returned: 0 in 0.489s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1144953095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c41be58-83f2-45e4-b090-c0c2e14595f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:35Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Creating volume 5c41be58-83f2-45e4-b090-c0c2e14595f6 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:36 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2af7745-5567-4a0f-8e69-fbfb35e06dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d34dda-843a-4356-9624-ba4f9faf02b3', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429090dd-1a77-489b-aa16-d901778ca47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack sudo[100822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6 1073741824
Nov 05 12:06:36 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:36 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Volume volume-c0d34dda-843a-4356-9624-ba4f9faf02b3 (c0d34dda-843a-4356-9624-ba4f9faf02b3): created successfully
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429090dd-1a77-489b-aa16-d901778ca47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (c70db86d-72c5-4c5e-9ba6-aa2a2d91469e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:36 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8d6c2b73-ba70-4855-9f2d-5fcd27c529d1 tempest-CreateVolumesFromImageTest-2021441335 None] Created volume successfully.
Nov 05 12:06:36 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c5c1bad1-1442-423f-90db-886e84552e77" returned: 0 in 0.528s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-quobyte-c5c1bad1-1442-423f-90db-886e84552e77" released by "delete_volume" :: held 1.435s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (25f1481f-4dc6-437f-9c1e-d9182fd61089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794f66ca-8cee-4187-82e4-dbe08def844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794f66ca-8cee-4187-82e4-dbe08def844d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139786442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62b3096-a82e-4711-86de-b7d85557e7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:37Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09ce985-ebc1-4211-935b-346d69d9602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09ce985-ebc1-4211-935b-346d69d9602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122a55fc-4a9a-47ab-ad51-e588fc6674e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122a55fc-4a9a-47ab-ad51-e588fc6674e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62b3096-a82e-4711-86de-b7d85557e7dc', 'volume_name': 'volume-b62b3096-a82e-4711-86de-b7d85557e7dc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acfd06d-f22a-47e9-b0ba-72800d52d2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acfd06d-f22a-47e9-b0ba-72800d52d2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac57b2f5-cc67-4480-b5f3-ed4d92266051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:36 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Volume b62b3096-a82e-4711-86de-b7d85557e7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62b3096-a82e-4711-86de-b7d85557e7dc', 'volume_size': 1}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Created reservations ['5ba857d7-65d1-4685-bed1-6b864f56757a', '2e11b760-20cd-47dc-9f10-4baa92e37305', '1a1780e9-c3a3-4c6c-b0cf-536084ac76e3', 'd5eafaf0-72ff-4aa2-a571-46c4ecdee33e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:36 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6 1073741824" returned: 0 in 0.721s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:37 devstack sudo[100829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6
Nov 05 12:06:37 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:37 devstack sudo[100831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:37 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (fd61b9a4-d585-4ca5-89fa-532bf4b5092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cebc87-c1f2-490d-be19-e9d04c1a5c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cebc87-c1f2-490d-be19-e9d04c1a5c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027796551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ce2f4f-e646-4422-a232-ce6e34195c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:37Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ef034d-7e19-4938-bf82-b02eb0bf7671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ef034d-7e19-4938-bf82-b02eb0bf7671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcb1460-cc34-4f6a-87ad-798ee3fb2445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcb1460-cc34-4f6a-87ad-798ee3fb2445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ce2f4f-e646-4422-a232-ce6e34195c36', 'volume_name': 'volume-73ce2f4f-e646-4422-a232-ce6e34195c36', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b2fdd3-bcdf-4d15-a86f-afc8165d4aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b2fdd3-bcdf-4d15-a86f-afc8165d4aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a12908-5e63-4396-9cd2-db49b83cfec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Volume 73ce2f4f-e646-4422-a232-ce6e34195c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ce2f4f-e646-4422-a232-ce6e34195c36', 'volume_size': 1}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:37 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6" returned: 0 in 0.335s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.169s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1423169659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d640a97-17b3-4f4e-a70b-bd26ebcc40a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:36Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Creating volume 4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:37 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.313s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb5378b-b6b1-4523-bea0-86d0f5846437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c41be58-83f2-45e4-b090-c0c2e14595f6', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:37 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 1073741824
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90614275-71a9-433b-a6e0-5193456e9cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:37 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Deleted volume successfully.
Nov 05 12:06:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Volume volume-5c41be58-83f2-45e4-b090-c0c2e14595f6 (5c41be58-83f2-45e4-b090-c0c2e14595f6): created successfully
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90614275-71a9-433b-a6e0-5193456e9cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (2d522f41-77b3-40b8-977e-e588604f7340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-01b3021b-d357-402d-9425-cdf8c5c6807b tempest-VolumesDeleteCascade-749329031 None] Lock "cinder-c5c1bad1-1442-423f-90db-886e84552e77-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1161b0a6-a6e1-48ce-a7a3-8fa92932d506 tempest-CreateVolumesFromImageTest-2021441335 None] Created volume successfully.
Nov 05 12:06:37 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 1073741824" returned: 0 in 0.663s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:38 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7
Nov 05 12:06:38 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:38 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7" returned: 0 in 0.343s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139786442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62b3096-a82e-4711-86de-b7d85557e7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:37Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Creating volume b62b3096-a82e-4711-86de-b7d85557e7dc {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:38 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34e9f68-7397-4c6f-871f-d91572c0af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8589c46e-4087-4195-9565-5d6083fae09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:38 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc 1073741824
Nov 05 12:06:38 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Volume volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 (4d640a97-17b3-4f4e-a70b-bd26ebcc40a7): created successfully
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8589c46e-4087-4195-9565-5d6083fae09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (fd5f9c79-ce59-4e11-a6c7-cbd1babe73b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b93190e9-2605-4d70-ac12-97c7ac14cde2 tempest-CreateVolumesFromImageTest-2021441335 None] Created volume successfully.
Nov 05 12:06:39 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc 1073741824" returned: 0 in 0.598s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:39 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc
Nov 05 12:06:39 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:39 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc" returned: 0 in 0.339s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.238s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027796551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ce2f4f-e646-4422-a232-ce6e34195c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b76312611d40aa8b8b06320a9eedf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:37Z,use_quota=True,user_id='dfe2a010d99b4ff89228c422f0d43423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Creating volume 73ce2f4f-e646-4422-a232-ce6e34195c36 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:39 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:39 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36 1073741824
Nov 05 12:06:39 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac57b2f5-cc67-4480-b5f3-ed4d92266051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62b3096-a82e-4711-86de-b7d85557e7dc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657785f0-70a7-4603-b475-56df187060ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:39 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Volume volume-b62b3096-a82e-4711-86de-b7d85557e7dc (b62b3096-a82e-4711-86de-b7d85557e7dc): created successfully
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657785f0-70a7-4603-b475-56df187060ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (25f1481f-4dc6-437f-9c1e-d9182fd61089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-69816ec9-26c8-4e13-845f-7c3cf5555f08 tempest-CreateVolumesFromImageTest-2021441335 None] Created volume successfully.
Nov 05 12:06:40 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36 1073741824" returned: 0 in 0.604s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:40 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36
Nov 05 12:06:40 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:40 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36" returned: 0 in 0.304s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a12908-5e63-4396-9cd2-db49b83cfec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ce2f4f-e646-4422-a232-ce6e34195c36', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f2bbe3-162f-47b5-9b0f-4a838276739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:40 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Volume volume-73ce2f4f-e646-4422-a232-ce6e34195c36 (73ce2f4f-e646-4422-a232-ce6e34195c36): created successfully
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f2bbe3-162f-47b5-9b0f-4a838276739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Flow 'volume_create_manager' (fd61b9a4-d585-4ca5-89fa-532bf4b5092b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d4140eda-f0e0-4c2b-876f-12c5c07c5e60 tempest-CreateVolumesFromImageTest-2021441335 None] Created volume successfully.
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-73ce2f4f-e646-4422-a232-ce6e34195c36-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-73ce2f4f-e646-4422-a232-ce6e34195c36-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-quobyte-73ce2f4f-e646-4422-a232-ce6e34195c36" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-73ce2f4f-e646-4422-a232-ce6e34195c36" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1deb4f-3406-4add-b773-ae6b92fe35d6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:40 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36
Nov 05 12:06:40 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:41 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36" returned: 0 in 0.458s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:41 devstack sudo[100868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36
Nov 05 12:06:41 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:41 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-73ce2f4f-e646-4422-a232-ce6e34195c36" returned: 0 in 0.287s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-73ce2f4f-e646-4422-a232-ce6e34195c36" released by "delete_volume" :: held 0.800s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Created reservations ['a9682671-624f-4cd1-97a8-de4ac93e2b88', 'efeacb37-d3a0-4ef8-bd15-94f6820ab251', '4a14d2c7-1c90-4007-a8e2-f7b58af13927', '98b0eb53-823a-42e3-8785-c65117a82c16'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:41 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:41 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-b62b3096-a82e-4711-86de-b7d85557e7dc-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-b62b3096-a82e-4711-86de-b7d85557e7dc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:41 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.308s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-quobyte-b62b3096-a82e-4711-86de-b7d85557e7dc" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Deleted volume successfully.
Nov 05 12:06:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-b62b3096-a82e-4711-86de-b7d85557e7dc" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8b5a1835-3b4e-4531-8b6b-88672825fee2 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-73ce2f4f-e646-4422-a232-ce6e34195c36-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b844c747-daff-460b-a1a9-0bc89f5437c1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:42 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc
Nov 05 12:06:42 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:42 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc" returned: 0 in 0.400s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:42 devstack sudo[100879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc
Nov 05 12:06:42 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:42 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b62b3096-a82e-4711-86de-b7d85557e7dc" returned: 0 in 0.294s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-b62b3096-a82e-4711-86de-b7d85557e7dc" released by "delete_volume" :: held 0.761s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Created reservations ['db8c6475-8a30-4e83-8d15-b1b32829f1ad', '5320a616-9868-4d95-b4de-737e0f9aba4c', '89625793-3462-4d12-8c5c-6b8ae027412e', 'd7c65cc5-fe26-4cff-ae3d-9992b23fd9a9'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:42 devstack sudo[100882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:42 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-quobyte-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d24f647-58f7-4f2f-8893-7ec73055381b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:43 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.349s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:43 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Deleted volume successfully.
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d5703d46-250f-4054-abda-5034c7cabefb tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-b62b3096-a82e-4711-86de-b7d85557e7dc-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:43 devstack sudo[100885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7
Nov 05 12:06:43 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:43 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7" returned: 0 in 0.477s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:43 devstack sudo[100891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7
Nov 05 12:06:43 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:44 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7" returned: 0 in 0.322s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7" released by "delete_volume" :: held 0.864s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Created reservations ['6c84f767-8600-4ae4-925e-25cc673ce4cc', '43942b72-79e6-4b32-9c2f-5c1eb1f65ad1', '900436f1-72d1-4112-889f-238ce0f2beff', '6f63a439-1b5b-4e8c-bdba-da7246e4c4df'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:44 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:44 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-5c41be58-83f2-45e4-b090-c0c2e14595f6-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-5c41be58-83f2-45e4-b090-c0c2e14595f6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-quobyte-5c41be58-83f2-45e4-b090-c0c2e14595f6" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-5c41be58-83f2-45e4-b090-c0c2e14595f6" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[387e422c-cd2a-4906-9a64-80f9285c6905]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:44 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:44 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6
Nov 05 12:06:44 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.392s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Deleted volume successfully.
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-60bcb699-59a3-4a6a-a762-11fb0e14844c tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-4d640a97-17b3-4f4e-a70b-bd26ebcc40a7-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:44 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6" returned: 0 in 0.496s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:44 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6
Nov 05 12:06:44 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:45 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c41be58-83f2-45e4-b090-c0c2e14595f6" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-5c41be58-83f2-45e4-b090-c0c2e14595f6" released by "delete_volume" :: held 0.856s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Created reservations ['5169f1af-6b8b-438e-a47e-31f1cc442e58', '5882b6b6-9199-4d3b-bdd0-7582735f2684', '1bf7937b-dd0f-4eff-bd37-64853a886c43', 'ec3300a2-2fa4-4d7e-89e7-ec823e4083b0'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:45 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:45 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-c0d34dda-843a-4356-9624-ba4f9faf02b3-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-c0d34dda-843a-4356-9624-ba4f9faf02b3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Flow 'volume_create_manager' (f8df1dd8-d91f-4f5f-877c-a56d582edada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0827fb15-d042-458c-a4ee-76d35a315b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0827fb15-d042-458c-a4ee-76d35a315b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-387073729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38592ccc-5acb-4231-a762-6c4e5c642dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b972a6e12f44abb9dfe73f8da15fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:46Z,use_quota=True,user_id='5c3f226bd27b402fb9bc8c2e336e465b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6252e87c-2da4-42dc-acba-44c3820521b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6252e87c-2da4-42dc-acba-44c3820521b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:45 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3528bbfe-fcfd-4cc4-a77e-15bb3d365957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3528bbfe-fcfd-4cc4-a77e-15bb3d365957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38592ccc-5acb-4231-a762-6c4e5c642dd5', 'volume_name': 'volume-38592ccc-5acb-4231-a762-6c4e5c642dd5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3d48d2-3316-41d5-b15f-9b5771b0bcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3d48d2-3316-41d5-b15f-9b5771b0bcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3a6a27-fda5-4646-ba12-1ebad3092e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:45 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Volume 38592ccc-5acb-4231-a762-6c4e5c642dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38592ccc-5acb-4231-a762-6c4e5c642dd5', 'volume_size': 1}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-387073729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38592ccc-5acb-4231-a762-6c4e5c642dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b972a6e12f44abb9dfe73f8da15fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:46Z,use_quota=True,user_id='5c3f226bd27b402fb9bc8c2e336e465b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Creating volume 38592ccc-5acb-4231-a762-6c4e5c642dd5 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:45 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "cinder-quobyte-c0d34dda-843a-4356-9624-ba4f9faf02b3" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.439s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:45 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5 1073741824
Nov 05 12:06:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Deleted volume successfully.
Nov 05 12:06:45 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-c0d34dda-843a-4356-9624-ba4f9faf02b3" acquired by "delete_volume" :: waited 0.040s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7e268e2a-db2e-4730-a622-d3bdadd6e2f9 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-5c41be58-83f2-45e4-b090-c0c2e14595f6-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e683223-fc3d-44dc-8152-79d9bc850fbd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:46 devstack sudo[100911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3
Nov 05 12:06:46 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:46 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5 1073741824" returned: 0 in 0.582s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:46 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3" returned: 0 in 0.487s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:46 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3
Nov 05 12:06:46 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:46 devstack sudo[100922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5
Nov 05 12:06:46 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:46 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:46 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c0d34dda-843a-4356-9624-ba4f9faf02b3" returned: 0 in 0.383s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5" returned: 0 in 0.364s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-quobyte-c0d34dda-843a-4356-9624-ba4f9faf02b3" released by "delete_volume" :: held 0.944s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3a6a27-fda5-4646-ba12-1ebad3092e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38592ccc-5acb-4231-a762-6c4e5c642dd5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1aa404-4d6c-482d-8b4a-ce43f49282c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:46 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Volume volume-38592ccc-5acb-4231-a762-6c4e5c642dd5 (38592ccc-5acb-4231-a762-6c4e5c642dd5): created successfully
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1aa404-4d6c-482d-8b4a-ce43f49282c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Flow 'volume_create_manager' (f8df1dd8-d91f-4f5f-877c-a56d582edada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8c34c88d-4dc3-4472-981e-675826253b5b tempest-VolumesTransfersV357Test-1060337704 None] Created volume successfully.
Nov 05 12:06:46 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Created reservations ['5e5ad26e-477c-4675-96b0-99db26544110', '4a242b4e-2a08-4114-a01d-4fdcb6d80b62', 'ea8f03b6-3d47-4e81-be00-aa5e56f2c86e', 'bd6fd21c-fc63-49bb-a8c4-9f67d33d8850'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:47 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:47 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:47 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.308s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Deleted volume successfully.
Nov 05 12:06:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-26e94512-2724-4a78-9d43-eac1af737976 tempest-CreateVolumesFromImageTest-2021441335 None] Lock "cinder-c0d34dda-843a-4356-9624-ba4f9faf02b3-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f99314b7-74aa-4f98-aa1c-a41ef6415f28 tempest-VolumesTransfersV357Test-1389270535 None] Transfer volume completed successfully.
Nov 05 12:06:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Acquiring lock "cinder-38592ccc-5acb-4231-a762-6c4e5c642dd5-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-38592ccc-5acb-4231-a762-6c4e5c642dd5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=158,cinder:INSERT=54,cinder:UPDATE=207,cinder:DELETE=9 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Acquiring lock "cinder-quobyte-38592ccc-5acb-4231-a762-6c4e5c642dd5" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-quobyte-38592ccc-5acb-4231-a762-6c4e5c642dd5" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb6e258-8533-467c-91ff-5226b89ec914]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:50 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5
Nov 05 12:06:50 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:50 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5" returned: 0 in 0.473s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:50 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5
Nov 05 12:06:50 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:50 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-38592ccc-5acb-4231-a762-6c4e5c642dd5" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-quobyte-38592ccc-5acb-4231-a762-6c4e5c642dd5" released by "delete_volume" :: held 0.894s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:50 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=165,cinder:UPDATE=176,cinder:INSERT=46,cinder:DELETE=16 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Created reservations ['44c3ddb1-8f40-492a-a741-475ee285fa07', 'aa4f11a0-46bb-4b42-b888-9a78dad7c01c', 'f15a6975-f5bd-4dd4-b25d-91370c33b6cf', '7a896567-fc2a-43c5-90e5-5fd48a159fc5'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:51 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:51 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:51 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.325s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Deleted volume successfully.
Nov 05 12:06:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8ea2b50-5a23-4df8-b4c6-2f1d0a55c5e1 tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-38592ccc-5acb-4231-a762-6c4e5c642dd5-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Flow 'volume_create_manager' (b45243c6-5033-446f-b052-983b18d6ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56276938-181f-4aba-aa8d-b612ff3fc9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56276938-181f-4aba-aa8d-b612ff3fc9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1670689431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29cb876-4193-4e38-aad7-00dfd94349b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b972a6e12f44abb9dfe73f8da15fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:52Z,use_quota=True,user_id='5c3f226bd27b402fb9bc8c2e336e465b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e1128f-6627-45df-80a9-7abb9845ddb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e1128f-6627-45df-80a9-7abb9845ddb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6231b763-645e-4adf-8c97-664e2552b508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6231b763-645e-4adf-8c97-664e2552b508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29cb876-4193-4e38-aad7-00dfd94349b9', 'volume_name': 'volume-c29cb876-4193-4e38-aad7-00dfd94349b9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9a034-46ea-48e5-a44b-8642a08ed66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9a034-46ea-48e5-a44b-8642a08ed66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54bfad1-73ae-4b95-ae4e-2aa14f6b06a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:52 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Volume c29cb876-4193-4e38-aad7-00dfd94349b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29cb876-4193-4e38-aad7-00dfd94349b9', 'volume_size': 1}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1670689431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29cb876-4193-4e38-aad7-00dfd94349b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b972a6e12f44abb9dfe73f8da15fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:06:52Z,use_quota=True,user_id='5c3f226bd27b402fb9bc8c2e336e465b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Creating volume c29cb876-4193-4e38-aad7-00dfd94349b9 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:06:52 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:52 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9 1073741824
Nov 05 12:06:52 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:52 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9 1073741824" returned: 0 in 0.520s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:52 devstack sudo[100946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9
Nov 05 12:06:52 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:53 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9" returned: 0 in 0.303s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:06:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54bfad1-73ae-4b95-ae4e-2aa14f6b06a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29cb876-4193-4e38-aad7-00dfd94349b9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d02301d-7348-4471-9e27-ab34f479158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:06:53 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Volume volume-c29cb876-4193-4e38-aad7-00dfd94349b9 (c29cb876-4193-4e38-aad7-00dfd94349b9): created successfully
Nov 05 12:06:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d02301d-7348-4471-9e27-ab34f479158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:06:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Flow 'volume_create_manager' (b45243c6-5033-446f-b052-983b18d6ba77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:06:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1f36cda0-04a6-4734-8cc4-8da81fdcafb3 tempest-VolumesTransfersV357Test-1060337704 None] Created volume successfully.
Nov 05 12:06:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Acquiring lock "cinder-c29cb876-4193-4e38-aad7-00dfd94349b9-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-c29cb876-4193-4e38-aad7-00dfd94349b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Acquiring lock "cinder-quobyte-c29cb876-4193-4e38-aad7-00dfd94349b9" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:06:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-quobyte-c29cb876-4193-4e38-aad7-00dfd94349b9" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:06:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf44f19-f72e-45b5-94c0-54060be235f7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:06:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:54 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9
Nov 05 12:06:54 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:55 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9" returned: 0 in 0.509s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:55 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9
Nov 05 12:06:55 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:55 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c29cb876-4193-4e38-aad7-00dfd94349b9" returned: 0 in 0.302s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-quobyte-c29cb876-4193-4e38-aad7-00dfd94349b9" released by "delete_volume" :: held 0.876s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Created reservations ['67a224be-bb3b-4409-abc8-591fe9c01459', '6acf4db0-10a8-4d87-a93b-177c9182f284', '65c94a8e-e402-40a2-8749-f1ab40563496', 'ed3d3983-c7b1-40f9-a027-bd0d86fa342b'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:06:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:06:55 devstack sudo[100959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:06:55 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:06:56 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root
Nov 05 12:06:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.379s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:06:56 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:06:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Deleted volume successfully.
Nov 05 12:06:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ffb3a71a-d38a-40d1-bcd6-478ea047261b tempest-VolumesTransfersV357Test-1796563148 None] Lock "cinder-c29cb876-4193-4e38-aad7-00dfd94349b9-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Flow 'volume_create_manager' (5844de6c-e6e5-48b6-b9f5-a57a18c80699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f9daf5-2c4d-4e07-ba9b-4a1c50de9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f9daf5-2c4d-4e07-ba9b-4a1c50de9284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-397333346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bd8c39-4a2f-47d4-ad2b-be7c93eb2712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfcbbdb2a72450a91c1403fbfa5d86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:05Z,use_quota=True,user_id='63d1a6d0b637413883ce3da9bae74e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1299a2ec-6cad-4e31-a082-5f3e141e7e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1299a2ec-6cad-4e31-a082-5f3e141e7e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee94c9f0-5d19-4d47-a451-46fe702e5854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee94c9f0-5d19-4d47-a451-46fe702e5854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bd8c39-4a2f-47d4-ad2b-be7c93eb2712', 'volume_name': 'volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e12c327-e371-46f1-8c2d-ce16f77d5338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e12c327-e371-46f1-8c2d-ce16f77d5338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faabe555-03a2-4129-bc6e-80ca59fc4ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:05 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Volume 12bd8c39-4a2f-47d4-ad2b-be7c93eb2712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712', 'volume_size': 1}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-397333346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bd8c39-4a2f-47d4-ad2b-be7c93eb2712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfcbbdb2a72450a91c1403fbfa5d86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:05Z,use_quota=True,user_id='63d1a6d0b637413883ce3da9bae74e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Creating volume 12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:05 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:07:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:05 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 1073741824
Nov 05 12:07:05 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:06 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 1073741824" returned: 0 in 0.593s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:06 devstack sudo[100974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712
Nov 05 12:07:06 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:06 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faabe555-03a2-4129-bc6e-80ca59fc4ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b852f5c8-e25c-4518-90da-5418e74d6515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Volume volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 (12bd8c39-4a2f-47d4-ad2b-be7c93eb2712): created successfully
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b852f5c8-e25c-4518-90da-5418e74d6515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Flow 'volume_create_manager' (5844de6c-e6e5-48b6-b9f5-a57a18c80699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-737af8d9-a9f2-4dc0-a1de-9e68afa34b95 tempest-SnapshotMetadataTestJSON-125916976 None] Created volume successfully.
Nov 05 12:07:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Creating offline snapshot b0c12b02-b96b-44f4-8106-1142eab78d40 of volume 12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:07:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6554ce-c449-4f60-943f-9f915b8480f4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:07 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712
Nov 05 12:07:07 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:08 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" returned: 0 in 0.428s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:08 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 1G
Nov 05 12:07:08 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:08 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 1G" returned: 0 in 0.451s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:08 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40
Nov 05 12:07:08 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:09 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40" returned: 0 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:09 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 is being set with open permissions: ugo+rw
Nov 05 12:07:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:09 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40
Nov 05 12:07:09 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:09 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40" returned: 0 in 0.427s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:09 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.info
Nov 05 12:07:09 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:09 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.info" returned: 0 in 0.294s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:09 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.info is being set with open permissions: ugo+rw
Nov 05 12:07:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:09 devstack sudo[101034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.info
Nov 05 12:07:09 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:10 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.info" returned: 0 in 0.271s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:10 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b4fe3066-b42b-4ada-94f7-926dba966c35 tempest-SnapshotMetadataTestJSON-125916976 None] Create snapshot completed successfully
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "cinder-b0c12b02-b96b-44f4-8106-1142eab78d40-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-b0c12b02-b96b-44f4-8106-1142eab78d40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "cinder-quobyte-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-quobyte-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "cinder-quobyte-b0c12b02-b96b-44f4-8106-1142eab78d40" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-quobyte-b0c12b02-b96b-44f4-8106-1142eab78d40" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Deleting offline snapshot b0c12b02-b96b-44f4-8106-1142eab78d40 of volume 12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] snapshot_file for this snap is: volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09938d4-4fe8-49ba-898a-03d274d5ae27]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:12 devstack sudo[101037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40
Nov 05 12:07:12 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:12 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40" returned: 0 in 0.464s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:07:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[504253ee-6581-4d39-a9e7-125766f09c39]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:12 devstack sudo[101044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712
Nov 05 12:07:12 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:12 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" returned: 0 in 0.414s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:12 devstack sudo[101049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40
Nov 05 12:07:12 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:13 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40" returned: 0 in 0.395s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:13 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40
Nov 05 12:07:13 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:13 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712.b0c12b02-b96b-44f4-8106-1142eab78d40" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-quobyte-b0c12b02-b96b-44f4-8106-1142eab78d40" released by "_delete_snapshot" :: held 1.698s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-quobyte-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" released by "delete_snapshot" :: held 1.738s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:13 devstack sudo[101057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:07:13 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Created reservations ['f30afb44-c4e9-48ec-a403-27c3b2e9c438', '3d85b5b7-606b-493f-b400-ec336e2a6070', '56000f0c-901a-4da1-9b50-fbfe4e7b618f', '97fe61f1-7192-4f90-946e-d7c5a8d6fca8'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:07:13 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Delete snapshot completed successfully.
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-863458e9-87be-44ac-a0af-88369ca31840 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-b0c12b02-b96b-44f4-8106-1142eab78d40-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:13 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.325s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:07:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "cinder-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "cinder-quobyte-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-quobyte-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b42ac1-9fda-4f6d-8d82-a247645d5463]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:14 devstack sudo[101061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712
Nov 05 12:07:14 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:14 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" returned: 0 in 0.391s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:14 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712
Nov 05 12:07:14 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:14 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" returned: 0 in 0.376s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-quobyte-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712" released by "delete_volume" :: held 0.858s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Created reservations ['915ea26f-2a93-46c5-8ab5-063e2172a233', 'e5cbfc0d-ba99-4b2a-af97-ee5220f1b98d', '011c1e54-5107-4287-913c-d968c312a568', '08e792a9-4a59-48f9-8b0e-9fd7948853ac'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:15 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:07:15 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:15 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.307s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:07:15 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Deleted volume successfully.
Nov 05 12:07:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-894ac8fa-4292-4e2c-9478-699f8ca300f1 tempest-SnapshotMetadataTestJSON-125916976 None] Lock "cinder-12bd8c39-4a2f-47d4-ad2b-be7c93eb2712-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Flow 'volume_create_manager' (a87d3e92-f856-4b1c-9c60-bfc6e35b7a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0730c822-699c-4ff1-922b-dadd4ecb7888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0730c822-699c-4ff1-922b-dadd4ecb7888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2121091529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602851cc-4b6a-4fc6-9b35-7d77fdc67de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa03d159e52747caa0be2f414f79b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:17Z,use_quota=True,user_id='25c335abefcc42d38c678aa1dfcbba6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a122a3-bfa1-4331-a61b-26d7ec91a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a122a3-bfa1-4331-a61b-26d7ec91a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89667d7-1057-41d7-b197-b9fa8f09e05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89667d7-1057-41d7-b197-b9fa8f09e05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602851cc-4b6a-4fc6-9b35-7d77fdc67de2', 'volume_name': 'volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d47e2c4-fd02-4485-9238-392331fca8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d47e2c4-fd02-4485-9238-392331fca8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27a8f66-63f5-466d-a5de-9fdd5a3af85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:17 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Volume 602851cc-4b6a-4fc6-9b35-7d77fdc67de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2', 'volume_size': 1}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2121091529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602851cc-4b6a-4fc6-9b35-7d77fdc67de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa03d159e52747caa0be2f414f79b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:17Z,use_quota=True,user_id='25c335abefcc42d38c678aa1dfcbba6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Creating volume 602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:17 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:17 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 1073741824
Nov 05 12:07:17 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:17 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 1073741824" returned: 0 in 0.530s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:17 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:07:17 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:18 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27a8f66-63f5-466d-a5de-9fdd5a3af85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44ca60c-3701-49a2-ad97-ff4110a5a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:18 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Volume volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 (602851cc-4b6a-4fc6-9b35-7d77fdc67de2): created successfully
Nov 05 12:07:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44ca60c-3701-49a2-ad97-ff4110a5a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Flow 'volume_create_manager' (a87d3e92-f856-4b1c-9c60-bfc6e35b7a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e4f45b35-6ce5-48f9-9b3e-e57d8846eada tempest-VolumesActionsTest-802887514 None] Created volume successfully.
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Flow 'volume_create_manager' (0b5cd1f1-71ce-46ad-b928-10e584c5f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b68c9e0-3d8a-4191-92bb-e77ccd4176d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b68c9e0-3d8a-4191-92bb-e77ccd4176d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1821138495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d012b603-aab1-448c-98e1-76df69cde366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0506e7abaded448bb1d7dc0dd73a8ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:20Z,use_quota=True,user_id='edb27218f6ff474ca6e52ca26672e393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23738cef-7bcb-40d2-beb9-23b27435146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23738cef-7bcb-40d2-beb9-23b27435146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97814512-4797-494f-b0eb-803fc32d55e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97814512-4797-494f-b0eb-803fc32d55e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd012b603-aab1-448c-98e1-76df69cde366', 'volume_name': 'volume-d012b603-aab1-448c-98e1-76df69cde366', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028cc3680>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0035018-05ba-4b10-bbb9-72b80bf013af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0035018-05ba-4b10-bbb9-72b80bf013af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4371e6-0311-4e22-9cd6-dd3155447781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:20 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Volume d012b603-aab1-448c-98e1-76df69cde366: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d012b603-aab1-448c-98e1-76df69cde366', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028cc3680>}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Trying to clone d012b603-aab1-448c-98e1-76df69cde366 from image 71120f13-1140-4938-836f-6085e103efeb at location (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:07:20 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a9139-0ffe-416e-ba4b-dbaa1fa084b4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:21 devstack sudo[101087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD
Nov 05 12:07:21 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:21 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb is fetched for user edb27218f6ff474ca6e52ca26672e393. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[979cbc55-30ae-4c26-a3b1-c16b17756d33]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:21 devstack sudo[101092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD
Nov 05 12:07:21 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:21 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1821138495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d012b603-aab1-448c-98e1-76df69cde366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0506e7abaded448bb1d7dc0dd73a8ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:20Z,use_quota=True,user_id='edb27218f6ff474ca6e52ca26672e393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Creating volume d012b603-aab1-448c-98e1-76df69cde366 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:21 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:07:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:21 devstack sudo[101098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 1073741824
Nov 05 12:07:21 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:22 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 1073741824" returned: 0 in 0.627s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:22 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366
Nov 05 12:07:22 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:22 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Attempting download of 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume d012b603-aab1-448c-98e1-76df69cde366. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd0f2d-dd9f-42b8-8bc1-2b1a12c4df33]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_5dbybpjr {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:23 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_5dbybpjr
Nov 05 12:07:23 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:23 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_5dbybpjr" returned: 0 in 0.377s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_5dbybpjr {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:23 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_5dbybpjr
Nov 05 12:07:23 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:23 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_5dbybpjr" returned: 1 in 0.355s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_5dbybpjr' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:07:23 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa4714d-98a3-47a9-a521-65ca20b9fbee]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:23 devstack sudo[101138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD
Nov 05 12:07:23 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:24 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:24 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] 71120f13-1140-4938-836f-6085e103efeb was qcow2, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:07:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:24 devstack sudo[101146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366
Nov 05 12:07:24 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:26 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366" returned: 0 in 2.732s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:26 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_69kjzybsdevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:07:26 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Converted 112.00 MB image at 40.97 MB/s
Nov 05 12:07:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:26 devstack sudo[101232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 1G
Nov 05 12:07:26 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-913e0f6a-cd34-4de7-b2ce-ab06689093b7 tempest-VolumesActionsTest-802887514 None] Acquiring lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" by "attach_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-913e0f6a-cd34-4de7-b2ce-ab06689093b7 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" acquired by "attach_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-913e0f6a-cd34-4de7-b2ce-ab06689093b7 tempest-VolumesActionsTest-802887514 None] Attaching volume 602851cc-4b6a-4fc6-9b35-7d77fdc67de2 to instance 1bc80288-3a4b-4296-9216-a7c60be22983 at mountpoint /dev/vdb on host None.
Nov 05 12:07:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-913e0f6a-cd34-4de7-b2ce-ab06689093b7 tempest-VolumesActionsTest-802887514 None] Attach volume completed successfully.
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-913e0f6a-cd34-4de7-b2ce-ab06689093b7 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" released by "attach_volume" :: held 0.115s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:27 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 1G" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Downloaded image 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume d012b603-aab1-448c-98e1-76df69cde366 successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb for user edb27218f6ff474ca6e52ca26672e393 is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Marking volume d012b603-aab1-448c-98e1-76df69cde366 as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Copying metadata from image 71120f13-1140-4938-836f-6085e103efeb to d012b603-aab1-448c-98e1-76df69cde366. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Creating volume glance metadata for volume d012b603-aab1-448c-98e1-76df69cde366 backed by image 71120f13-1140-4938-836f-6085e103efeb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f53c6870-efd8-4f8b-b48c-c53bea745715 tempest-VolumesActionsTest-802887514 None] Acquiring lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-detach_volume" by "detach_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f53c6870-efd8-4f8b-b48c-c53bea745715 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f53c6870-efd8-4f8b-b48c-c53bea745715 tempest-VolumesActionsTest-802887514 None] Detaching volume 602851cc-4b6a-4fc6-9b35-7d77fdc67de2 from instance 1bc80288-3a4b-4296-9216-a7c60be22983.
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4371e6-0311-4e22-9cd6-dd3155447781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d012b603-aab1-448c-98e1-76df69cde366', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028cc3680>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a26f99-2f56-420e-b69b-2050eb1a2f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Volume volume-d012b603-aab1-448c-98e1-76df69cde366 (d012b603-aab1-448c-98e1-76df69cde366): created successfully
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a26f99-2f56-420e-b69b-2050eb1a2f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Flow 'volume_create_manager' (0b5cd1f1-71ce-46ad-b928-10e584c5f595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f53c6870-efd8-4f8b-b48c-c53bea745715 tempest-VolumesActionsTest-802887514 None] Detach volume completed successfully.
Nov 05 12:07:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-561fc0db-cb67-4fe4-a0d4-c43d0ed5aa85 tempest-VolumesExtendTest-1746580556 None] Created volume successfully.
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f53c6870-efd8-4f8b-b48c-c53bea745715 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[01405bea-52cd-4f7c-b9cc-9e67ecdcbb99]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:27 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366
Nov 05 12:07:27 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:28 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366" returned: 0 in 0.535s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 2G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 2G" returned: 0 in 0.113s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.695s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-da5f6012-0d86-4383-a5d9-9e872d4aaa00 tempest-VolumesExtendTest-1746580556 None] Extend volume completed successfully.
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Acquiring lock "cinder-d012b603-aab1-448c-98e1-76df69cde366-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Lock "cinder-d012b603-aab1-448c-98e1-76df69cde366-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Acquiring lock "cinder-quobyte-d012b603-aab1-448c-98e1-76df69cde366" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-d012b603-aab1-448c-98e1-76df69cde366" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fa7db8-e490-4bfc-8bb5-772a76678abb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:29 devstack sudo[101269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366
Nov 05 12:07:29 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:29 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366" returned: 0 in 0.385s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:29 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366
Nov 05 12:07:29 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:29 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d012b603-aab1-448c-98e1-76df69cde366" returned: 0 in 0.259s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-d012b603-aab1-448c-98e1-76df69cde366" released by "delete_volume" :: held 0.694s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Created reservations ['782c76e9-df28-4ee2-97b3-2065559a9a64', '5b3d13a8-4c60-452d-b168-29bdbf780145', '33986ef7-88d3-41ab-9112-503a1cb82ece', 'fcdac3d6-68d4-4e45-ab6d-0fe0c79a87d3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:30 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:07:30 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:30 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.265s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:07:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Deleted volume successfully.
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9646038-420f-405e-8ffa-69e31eeb9f9f tempest-VolumesExtendTest-1746580556 None] Lock "cinder-d012b603-aab1-448c-98e1-76df69cde366-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Flow 'volume_create_manager' (49f5af97-5772-4fc6-b567-826e72d31bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d892d7-9037-47b3-b1fd-65874c9f4d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d892d7-9037-47b3-b1fd-65874c9f4d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-175808576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab5d75f-d450-486d-b370-71af25d22171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0506e7abaded448bb1d7dc0dd73a8ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:31Z,use_quota=True,user_id='edb27218f6ff474ca6e52ca26672e393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad650035-a46f-4966-b60e-f7977723336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad650035-a46f-4966-b60e-f7977723336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b67859a-f0f1-48e7-9552-f3d9043806d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b67859a-f0f1-48e7-9552-f3d9043806d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ab5d75f-d450-486d-b370-71af25d22171', 'volume_name': 'volume-2ab5d75f-d450-486d-b370-71af25d22171', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cb596f-e013-4db3-a965-1e2df27ef87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cb596f-e013-4db3-a965-1e2df27ef87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67226e0-559d-477c-b33c-53e785a0a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Volume 2ab5d75f-d450-486d-b370-71af25d22171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ab5d75f-d450-486d-b370-71af25d22171', 'volume_size': 1}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-175808576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab5d75f-d450-486d-b370-71af25d22171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0506e7abaded448bb1d7dc0dd73a8ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:31Z,use_quota=True,user_id='edb27218f6ff474ca6e52ca26672e393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Creating volume 2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:07:31 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:31 devstack sudo[101280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 1073741824
Nov 05 12:07:31 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:31 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 1073741824" returned: 0 in 0.574s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:31 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171
Nov 05 12:07:31 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:31 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171" returned: 0 in 0.315s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67226e0-559d-477c-b33c-53e785a0a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab5d75f-d450-486d-b370-71af25d22171', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdf139c-f167-41a7-87d2-c8c0648ae50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:31 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Volume volume-2ab5d75f-d450-486d-b370-71af25d22171 (2ab5d75f-d450-486d-b370-71af25d22171): created successfully
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdf139c-f167-41a7-87d2-c8c0648ae50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Flow 'volume_create_manager' (49f5af97-5772-4fc6-b567-826e72d31bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:31 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2508e6d1-34f8-4ef4-aab2-856715ba3b71 tempest-VolumesExtendTest-1746580556 None] Created volume successfully.
Nov 05 12:07:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Creating offline snapshot ae5486e2-545c-4ebe-8e52-64045ffea954 of volume 2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:07:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae7cf3-f183-41f7-8608-f52179f62fc2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:33 devstack sudo[101309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171
Nov 05 12:07:33 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:33 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171" returned: 0 in 0.451s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:33 devstack sudo[101314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 1G
Nov 05 12:07:33 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:34 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 1G" returned: 0 in 0.529s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab5d75f-d450-486d-b370-71af25d22171 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:34 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab5d75f-d450-486d-b370-71af25d22171 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954
Nov 05 12:07:34 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:34 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab5d75f-d450-486d-b370-71af25d22171 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954" returned: 0 in 0.376s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:34 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 is being set with open permissions: ugo+rw
Nov 05 12:07:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:34 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954
Nov 05 12:07:34 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:34 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954" returned: 0 in 0.323s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:35 devstack sudo[101331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.info
Nov 05 12:07:35 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:35 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.info" returned: 0 in 0.384s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:35 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.info is being set with open permissions: ugo+rw
Nov 05 12:07:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:35 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.info
Nov 05 12:07:35 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:35 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.info" returned: 0 in 0.375s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0449aad1-c9e9-46d3-90f7-b32195c9215e tempest-VolumesExtendTest-1746580556 None] Create snapshot completed successfully
Nov 05 12:07:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6363a3a-c797-4d15-bcb4-e8dba2b70092]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:36 devstack sudo[101403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171
Nov 05 12:07:36 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:37 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171" returned: 0 in 0.461s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 2G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 2G" returned: 0 in 0.178s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.685s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-da44c46a-d2c0-4080-b5e5-00d3cd20eb1b tempest-VolumesExtendTest-1746580556 None] Extend volume completed successfully.
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "cinder-ae5486e2-545c-4ebe-8e52-64045ffea954-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-ae5486e2-545c-4ebe-8e52-64045ffea954-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "cinder-quobyte-2ab5d75f-d450-486d-b370-71af25d22171" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-2ab5d75f-d450-486d-b370-71af25d22171" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "cinder-quobyte-ae5486e2-545c-4ebe-8e52-64045ffea954" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-ae5486e2-545c-4ebe-8e52-64045ffea954" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Deleting offline snapshot ae5486e2-545c-4ebe-8e52-64045ffea954 of volume 2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] snapshot_file for this snap is: volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee34d4-2644-4df4-849a-84cbda86043a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3048743c-f4f8-414d-b44e-28c6ac4c74d8 tempest-VolumesActionsTest-802887514 None] Acquiring lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" by "attach_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3048743c-f4f8-414d-b44e-28c6ac4c74d8 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" acquired by "attach_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3048743c-f4f8-414d-b44e-28c6ac4c74d8 tempest-VolumesActionsTest-802887514 None] Attaching volume 602851cc-4b6a-4fc6-9b35-7d77fdc67de2 to instance 2f12a943-63bd-45d5-bf48-d19b6316c10c at mountpoint /dev/vdb on host None.
Nov 05 12:07:38 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954
Nov 05 12:07:38 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3048743c-f4f8-414d-b44e-28c6ac4c74d8 tempest-VolumesActionsTest-802887514 None] Attach volume completed successfully.
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3048743c-f4f8-414d-b44e-28c6ac4c74d8 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" released by "attach_volume" :: held 0.138s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:38 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954" returned: 0 in 0.483s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ab5d75f-d450-486d-b370-71af25d22171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a755b5-5c3b-434d-a0c0-b9d9cb477a98]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-00f87fce-666f-4fbf-9169-95c0931f436c tempest-VolumesActionsTest-802887514 None] Acquiring lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-detach_volume" by "detach_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-00f87fce-666f-4fbf-9169-95c0931f436c tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-00f87fce-666f-4fbf-9169-95c0931f436c tempest-VolumesActionsTest-802887514 None] Detaching volume 602851cc-4b6a-4fc6-9b35-7d77fdc67de2 from instance 2f12a943-63bd-45d5-bf48-d19b6316c10c.
Nov 05 12:07:38 devstack sudo[101420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171
Nov 05 12:07:38 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-00f87fce-666f-4fbf-9169-95c0931f436c tempest-VolumesActionsTest-802887514 None] Detach volume completed successfully.
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-00f87fce-666f-4fbf-9169-95c0931f436c tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:38 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171" returned: 0 in 0.506s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:39 devstack sudo[101425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954
Nov 05 12:07:39 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:39 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954" returned: 0 in 0.570s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:39 devstack sudo[101449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954
Nov 05 12:07:39 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:39 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171.ae5486e2-545c-4ebe-8e52-64045ffea954" returned: 0 in 0.283s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-ae5486e2-545c-4ebe-8e52-64045ffea954" released by "_delete_snapshot" :: held 1.996s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-2ab5d75f-d450-486d-b370-71af25d22171" released by "delete_snapshot" :: held 2.023s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:39 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Created reservations ['18695d8c-5890-47e1-8dcb-956b01ebb31b', 'ab3d2ae2-882e-4c34-8f4e-efce8cc7d7dd', 'ad3d4e65-8ce2-4f96-a4e3-f2a513f14fbd', '9a286196-57a8-4f82-ae1a-6da198b33ed8'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:07:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Delete snapshot completed successfully.
Nov 05 12:07:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4755dedc-1a8f-4fd9-8890-a8831c8cacd8 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-ae5486e2-545c-4ebe-8e52-64045ffea954-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "cinder-2ab5d75f-d450-486d-b370-71af25d22171-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-2ab5d75f-d450-486d-b370-71af25d22171-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "cinder-quobyte-2ab5d75f-d450-486d-b370-71af25d22171" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-2ab5d75f-d450-486d-b370-71af25d22171" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029881e-0b6e-47b0-a697-11ea371c5ff8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:41 devstack sudo[101456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171
Nov 05 12:07:41 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:41 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171" returned: 0 in 0.400s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:41 devstack sudo[101462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171
Nov 05 12:07:41 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:41 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2ab5d75f-d450-486d-b370-71af25d22171" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-quobyte-2ab5d75f-d450-486d-b370-71af25d22171" released by "delete_volume" :: held 0.739s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:41 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Created reservations ['c0c9dcd4-5c7a-4a2b-93ae-e1f47bdd1ed9', '69e8ffc1-fe66-4a38-9a9a-d11189cdc9d7', 'f28f003e-5694-4240-8a0e-5b92b036e27c', '0562f612-5202-4b36-ae07-a7ce9c45d46f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:42 devstack sudo[101465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:07:42 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:42 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.301s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:07:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Deleted volume successfully.
Nov 05 12:07:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-957c75aa-4487-47d3-9a3e-b0ec75838294 tempest-VolumesExtendTest-1746580556 None] Lock "cinder-2ab5d75f-d450-486d-b370-71af25d22171-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:07:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:07:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:07:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec089c39-2817-4f33-a4ca-fcde62778765]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:43 devstack sudo[101468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:07:43 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:43 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.418s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf253f-b11a-492f-9b22-98d4415c5b67]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:43 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:07:43 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:44 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.410s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a6659637-528f-411d-9202-40865230c2f8k7d9z_qr.img {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:44 devstack sudo[101480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a6659637-528f-411d-9202-40865230c2f8k7d9z_qr.img
Nov 05 12:07:44 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:51 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a6659637-528f-411d-9202-40865230c2f8k7d9z_qr.img" returned: 0 in 6.962s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42fecfc-23bc-49c0-a8b3-828ea05845bd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:07:51 devstack sudo[101493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:07:51 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:07:51 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.553s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a6659637-528f-411d-9202-40865230c2f8k7d9z_qr.img {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:07:51 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Converted 1024.00 MB image at 147.05 MB/s
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:INSERT=27,cinder:UPDATE=79,cinder:SELECT=73,cinder:DELETE=8 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=81,cinder:INSERT=25,cinder:UPDATE=84,cinder:DELETE=4 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:07:51 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] a6659637-528f-411d-9202-40865230c2f8 was raw, no need to convert to raw {{(pid=87317) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Flow 'volume_create_manager' (487c82be-e433-4b97-9027-af44db815305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84184906-fe10-4fbe-a21c-081fcad24486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84184906-fe10-4fbe-a21c-081fcad24486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1259159376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da6cc511002432f8fb1297e59382740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:52Z,use_quota=True,user_id='cbbb26de5dde4e77a886dd549b2cd88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fc3839-ca87-45e2-beb1-f3c779e964c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fc3839-ca87-45e2-beb1-f3c779e964c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461cf62b-70e7-4c4b-a8f4-20986d1f68e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461cf62b-70e7-4c4b-a8f4-20986d1f68e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84', 'volume_name': 'volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b340532-7e94-421b-98a8-7bd97c6abc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b340532-7e94-421b-98a8-7bd97c6abc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05268738-9f04-4a54-8e01-39e2d7ab919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:07:52 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84', 'volume_size': 1}
Nov 05 12:07:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:02 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:08:02 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.136s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Uploaded volume to glance image-id: a6659637-528f-411d-9202-40865230c2f8. {{(pid=87317) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.230s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1259159376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da6cc511002432f8fb1297e59382740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:07:52Z,use_quota=True,user_id='cbbb26de5dde4e77a886dd549b2cd88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Creating volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:08:10 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:10 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 1073741824
Nov 05 12:08:10 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:10 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8f257690-0c22-491b-887e-0bc25a81c750 tempest-VolumesActionsTest-802887514 None] Copy volume to image completed successfully.
Nov 05 12:08:10 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 1073741824" returned: 0 in 0.456s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:11 devstack sudo[101549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84
Nov 05 12:08:11 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:11 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" returned: 0 in 0.264s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05268738-9f04-4a54-8e01-39e2d7ab919b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6344c9c8-bbbb-45ce-a42c-90f7510a2457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:11 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Volume volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 (4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84): created successfully
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6344c9c8-bbbb-45ce-a42c-90f7510a2457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Flow 'volume_create_manager' (487c82be-e433-4b97-9027-af44db815305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-526f0784-ad5d-44aa-85a7-909951c1b7bc tempest-VolumesSnapshotListTestJSON-867576118 None] Created volume successfully.
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c44bc13-3359-4aa7-b2d4-48582dcf3c32]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:12 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:08:12 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:12 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.381s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e885a9-072a-4e9b-af6c-f8283c57cad1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:13 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:08:13 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:13 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.378s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:13 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img
Nov 05 12:08:13 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:13 devstack sudo[101571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:08:13 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:14 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.445s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:08:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:08:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:08:19 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img" returned: 0 in 6.254s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:19 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27d6e3c-6ed5-43fe-9bac-bc8c3bd008be]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:19 devstack sudo[101580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:08:19 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:20 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.534s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:08:20 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Converted 1024.00 MB image at 163.72 MB/s
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] a053bbc5-0c68-43bb-b56c-86b39351a46b was raw, converting to qcow2 {{(pid=87317) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[969657ca-deac-412d-a25b-d74eb2cd73fa]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:20 devstack sudo[101585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img
Nov 05 12:08:20 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:20 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img" returned: 0 in 0.338s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:20 devstack sudo[101589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img
Nov 05 12:08:20 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:20 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img" returned: 1 in 0.326s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:08:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img /opt/stack/data/cinder/conversion/vol_upload_715bqmt9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:20 devstack sudo[101595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img /opt/stack/data/cinder/conversion/vol_upload_715bqmt9
Nov 05 12:08:20 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:21 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img /opt/stack/data/cinder/conversion/vol_upload_715bqmt9" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:21 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Image conversion details: src /opt/stack/data/cinder/conversion/602851cc-4b6a-4fc6-9b35-7d77fdc67de2.temp_image.a053bbc5-0c68-43bb-b56c-86b39351a46bduhyvk68.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_715bqmt9 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:08:21 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 12:08:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d795c94-21ae-48a6-9f5d-49065caf66c0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_715bqmt9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:21 devstack sudo[101601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_715bqmt9
Nov 05 12:08:21 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:21 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_715bqmt9" returned: 0 in 0.337s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:22 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:08:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.230s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:22 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Uploaded volume to glance image-id: a053bbc5-0c68-43bb-b56c-86b39351a46b. {{(pid=87317) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 12:08:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.097s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Creating offline snapshot 58efff0b-2034-4b85-871a-d3e1d2b80058 of volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:08:22 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4ec08d81-efc0-461b-84ff-725295bc195f tempest-VolumesActionsTest-802887514 None] Copy volume to image completed successfully.
Nov 05 12:08:22 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c80c86f-01a4-4197-bb3d-475b4ed6f369]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:22 devstack sudo[101608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84
Nov 05 12:08:22 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:23 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" returned: 0 in 0.374s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:23 devstack sudo[101613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 1G
Nov 05 12:08:23 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:23 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 1G" returned: 0 in 0.450s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Acquiring lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:23 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058
Nov 05 12:08:23 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Acquiring lock "cinder-quobyte-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Lock "cinder-quobyte-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" acquired by "delete_volume" :: waited 0.014s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b53433-7ec3-4a2c-b7b2-e0c7ad00b8ba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:23 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:08:23 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:23 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058" returned: 0 in 0.316s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:23 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 is being set with open permissions: ugo+rw
Nov 05 12:08:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:23 devstack sudo[101629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058
Nov 05 12:08:23 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:24 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.372s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:24 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2
Nov 05 12:08:24 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:24 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058" returned: 0 in 0.269s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:24 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.info
Nov 05 12:08:24 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:24 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Lock "cinder-quobyte-602851cc-4b6a-4fc6-9b35-7d77fdc67de2" released by "delete_volume" :: held 0.682s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Created reservations ['efa93583-95b3-454e-b7e0-f4520d8d0657', '25c525d3-e43e-497b-9eb5-d462f46077f3', '71a6724a-4832-46ac-9d99-b4b8c8b55767', '67cab84f-f554-4b10-93e2-a8f738baaafd'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:24 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.info" returned: 0 in 0.286s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:24 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.info is being set with open permissions: ugo+rw
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:24 devstack sudo[101641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:08:24 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:24 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.info
Nov 05 12:08:24 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:24 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:24 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.info" returned: 0 in 0.263s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Deleted volume successfully.
Nov 05 12:08:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a76f0d15-3f57-434d-a1c6-9064883595e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Create snapshot completed successfully
Nov 05 12:08:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc5aff85-f1fa-4603-8ca3-b746d1020132 tempest-VolumesActionsTest-802887514 None] Lock "cinder-602851cc-4b6a-4fc6-9b35-7d77fdc67de2-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Creating offline snapshot eb9947fe-2585-4597-969c-7b4b873b4145 of volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:08:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeaecd6-6996-4b7c-b242-ccdbe329b1b0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:25 devstack sudo[101647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058
Nov 05 12:08:25 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:26 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058" returned: 0 in 0.445s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:26 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 1G
Nov 05 12:08:26 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:26 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 1G" returned: 0 in 0.513s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:26 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145
Nov 05 12:08:26 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:26 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145" returned: 0 in 0.324s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:26 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 is being set with open permissions: ugo+rw
Nov 05 12:08:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:26 devstack sudo[101665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145
Nov 05 12:08:26 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:27 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145" returned: 0 in 0.265s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.658s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9b7d7283-e175-4dd5-861b-05410ebc48f5 tempest-VolumesSnapshotListTestJSON-867576118 None] Create snapshot completed successfully
Nov 05 12:08:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Creating offline snapshot ed94a201-2948-4188-a12b-033549eb60b0 of volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:08:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a2df99-3997-4486-bde7-0d6767efbb68]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:28 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145
Nov 05 12:08:28 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:28 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145" returned: 0 in 0.389s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:28 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 1G
Nov 05 12:08:28 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:28 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 1G" returned: 0 in 0.638s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:28 devstack sudo[101680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0
Nov 05 12:08:28 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:29 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0" returned: 0 in 0.332s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:29 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 is being set with open permissions: ugo+rw
Nov 05 12:08:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:29 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0
Nov 05 12:08:29 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:29 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0" returned: 0 in 0.281s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:29 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f9375e81-ed7f-4fb1-a642-8a30676f71e7 tempest-VolumesSnapshotListTestJSON-867576118 None] Create snapshot completed successfully
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-ed94a201-2948-4188-a12b-033549eb60b0-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-ed94a201-2948-4188-a12b-033549eb60b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-quobyte-ed94a201-2948-4188-a12b-033549eb60b0" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-ed94a201-2948-4188-a12b-033549eb60b0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Deleting offline snapshot ed94a201-2948-4188-a12b-033549eb60b0 of volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] snapshot_file for this snap is: volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b134b4-f0f1-4587-b1a8-10405eea3cf8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:31 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0
Nov 05 12:08:31 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:31 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0" returned: 0 in 0.384s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[45320f34-2fa9-40ce-82f7-d11b3f59bd66]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:31 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145
Nov 05 12:08:31 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:31 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145" returned: 0 in 0.423s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:32 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0
Nov 05 12:08:32 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:32 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0" returned: 0 in 0.456s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:32 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0
Nov 05 12:08:32 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:32 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.ed94a201-2948-4188-a12b-033549eb60b0" returned: 0 in 0.247s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-ed94a201-2948-4188-a12b-033549eb60b0" released by "_delete_snapshot" :: held 1.627s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" released by "delete_snapshot" :: held 1.658s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:32 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Created reservations ['be388ab6-6cf8-4367-8003-befe8984c93a', '134a2da9-ddee-4603-a34a-de94ec977cc7', 'a3fafab1-f987-42ce-a779-9f71c8f1f37c', 'ca6a14a3-a62e-4571-b040-1519e6cd798e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Delete snapshot completed successfully.
Nov 05 12:08:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b7ed9fd0-5afc-4481-8ad0-5445a86f1ad4 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-ed94a201-2948-4188-a12b-033549eb60b0-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-eb9947fe-2585-4597-969c-7b4b873b4145-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-eb9947fe-2585-4597-969c-7b4b873b4145-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-quobyte-eb9947fe-2585-4597-969c-7b4b873b4145" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-eb9947fe-2585-4597-969c-7b4b873b4145" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Deleting offline snapshot eb9947fe-2585-4597-969c-7b4b873b4145 of volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] snapshot_file for this snap is: volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba0d4d7-6ed9-400b-ab7e-679cc24aef9a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (98d6748e-c318-4d07-a3cf-28fd266613a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f6d03d-e6a7-41a9-9553-1fe3df31c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f6d03d-e6a7-41a9-9553-1fe3df31c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-187806538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa16a732-e61f-49d6-9dd6-cdfee60eef9b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:33Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed80e87-6a6b-4258-9a0d-76bf70eaac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed80e87-6a6b-4258-9a0d-76bf70eaac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5b0fa4-2b63-4451-8f1b-7055e083be35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5b0fa4-2b63-4451-8f1b-7055e083be35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa16a732-e61f-49d6-9dd6-cdfee60eef9b', 'volume_name': 'volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3008c75-3617-40c9-9fa2-bddf204a7edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3008c75-3617-40c9-9fa2-bddf204a7edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:33 devstack sudo[101710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145
Nov 05 12:08:33 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba71a3b-3b52-4184-9c20-eb1e71e09aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:33 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Volume aa16a732-e61f-49d6-9dd6-cdfee60eef9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b', 'volume_size': 1}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-187806538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa16a732-e61f-49d6-9dd6-cdfee60eef9b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:33Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Creating volume aa16a732-e61f-49d6-9dd6-cdfee60eef9b {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:08:33 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:33 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b 1073741824
Nov 05 12:08:33 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:33 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145" returned: 0 in 0.445s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b839e9a9-63f2-4ee2-a8e7-ac0e9e5db2d5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:33 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:33 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058
Nov 05 12:08:33 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b 1073741824" returned: 0 in 0.471s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:33 devstack sudo[101724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b
Nov 05 12:08:33 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:34 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058" returned: 0 in 0.432s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:34 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:34 devstack sudo[101730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145
Nov 05 12:08:34 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba71a3b-3b52-4184-9c20-eb1e71e09aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe074791-6a48-49b5-b9b0-9e53248dcb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Volume volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b (aa16a732-e61f-49d6-9dd6-cdfee60eef9b): created successfully
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe074791-6a48-49b5-b9b0-9e53248dcb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (98d6748e-c318-4d07-a3cf-28fd266613a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b3d3a37d-503d-4258-815c-21a9bfe00733 tempest-VolumesGetTest-519826712 None] Created volume successfully.
Nov 05 12:08:34 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145" returned: 0 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:34 devstack sudo[101736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145
Nov 05 12:08:34 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:34 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.eb9947fe-2585-4597-969c-7b4b873b4145" returned: 0 in 0.303s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-eb9947fe-2585-4597-969c-7b4b873b4145" released by "_delete_snapshot" :: held 1.713s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" released by "delete_snapshot" :: held 1.735s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Created reservations ['c61d717f-11e2-48af-b200-1a6d77ff8b8a', '44834a17-3bac-4c9e-baa3-eeb439294894', '4ac6a6f7-6ff5-4572-8d9b-f8ccf5f124cc', 'e455c4a0-0d8c-4241-9979-22ebe59bcf05'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Delete snapshot completed successfully.
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-56c0f5e7-4d90-46ab-b0b1-4802ad252953 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-eb9947fe-2585-4597-969c-7b4b873b4145-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-58efff0b-2034-4b85-871a-d3e1d2b80058-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-58efff0b-2034-4b85-871a-d3e1d2b80058-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-quobyte-58efff0b-2034-4b85-871a-d3e1d2b80058" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-58efff0b-2034-4b85-871a-d3e1d2b80058" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Deleting offline snapshot 58efff0b-2034-4b85-871a-d3e1d2b80058 of volume 4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] snapshot_file for this snap is: volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad2e256-c64d-4da1-acea-c3661b4fd144]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:35 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058
Nov 05 12:08:35 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:35 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058" returned: 0 in 0.387s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce543c1a-a50e-493f-9a7e-eee40d88de81]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:35 devstack sudo[101744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84
Nov 05 12:08:35 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (3c0c3e12-f902-4e66-a5a8-bfefc5c2b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b656c39-57b7-4696-acba-53e881f75ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:36 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" returned: 0 in 0.404s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:36 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058
Nov 05 12:08:36 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b656c39-57b7-4696-acba-53e881f75ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2069685695',display_name='tempest-VolumesGetTest-Volume-1368032627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0507b42b-28bc-4ebb-953d-4b5100c32005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:36Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56702862-dfa2-4532-b7c6-426ca9ec9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56702862-dfa2-4532-b7c6-426ca9ec9265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20026fa0-4a21-4b98-8045-6b47e780016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20026fa0-4a21-4b98-8045-6b47e780016f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0507b42b-28bc-4ebb-953d-4b5100c32005', 'volume_name': 'volume-0507b42b-28bc-4ebb-953d-4b5100c32005', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37194d9d-aba3-496f-9a23-0c6cc013db53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37194d9d-aba3-496f-9a23-0c6cc013db53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b4864-7c62-443a-8a66-eb36d5f354e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:36 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Volume 0507b42b-28bc-4ebb-953d-4b5100c32005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0507b42b-28bc-4ebb-953d-4b5100c32005', 'volume_size': 1}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2069685695',display_name='tempest-VolumesGetTest-Volume-1368032627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0507b42b-28bc-4ebb-953d-4b5100c32005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:36Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Creating volume 0507b42b-28bc-4ebb-953d-4b5100c32005 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:08:36 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:36 devstack sudo[101751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005 1073741824
Nov 05 12:08:36 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:36 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058" returned: 0 in 0.334s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:36 devstack sudo[101758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058
Nov 05 12:08:36 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:36 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005 1073741824" returned: 0 in 0.525s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:36 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84.58efff0b-2034-4b85-871a-d3e1d2b80058" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-58efff0b-2034-4b85-871a-d3e1d2b80058" released by "_delete_snapshot" :: held 1.527s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" released by "delete_snapshot" :: held 1.564s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:36 devstack sudo[101763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005
Nov 05 12:08:36 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:36 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Created reservations ['ccb97af7-21f0-4c59-9c40-2391f7241eaf', '400e1ff4-4e85-4894-a6b7-66d3385acc47', '982014dc-13d0-435b-9199-7a60fbb943c1', '3a410d89-6e3c-4451-8b89-c0fbde09f46f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Delete snapshot completed successfully.
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-256b9f6b-4a4b-4b02-ada3-8b409a00b5f7 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-58efff0b-2034-4b85-871a-d3e1d2b80058-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:37 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005" returned: 0 in 0.256s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7b4864-7c62-443a-8a66-eb36d5f354e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0507b42b-28bc-4ebb-953d-4b5100c32005', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a29bb-8658-4a28-b53b-ffe01dfa7b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Volume volume-0507b42b-28bc-4ebb-953d-4b5100c32005 (0507b42b-28bc-4ebb-953d-4b5100c32005): created successfully
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a29bb-8658-4a28-b53b-ffe01dfa7b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (3c0c3e12-f902-4e66-a5a8-bfefc5c2b287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-87922769-ea73-4cd2-bd2a-80e10002d021 tempest-VolumesGetTest-519826712 None] Created volume successfully.
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3272179-1cd5-47b5-b07b-196add5acd24]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:37 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84
Nov 05 12:08:37 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:38 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" returned: 0 in 0.372s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:38 devstack sudo[101771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84
Nov 05 12:08:38 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:38 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" returned: 0 in 0.325s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-quobyte-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84" released by "delete_volume" :: held 0.776s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-0507b42b-28bc-4ebb-953d-4b5100c32005-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Lock "cinder-0507b42b-28bc-4ebb-953d-4b5100c32005-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-0507b42b-28bc-4ebb-953d-4b5100c32005" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Created reservations ['5438f6b2-db19-4ce3-b7e1-af26ff11def5', '247a8c35-e7c8-424a-8700-e6c88b780bd8', '4d0a4cd6-86d7-45bc-8e7c-8b4ee8da5643', '5cd5d378-16ac-4f8d-b162-458f25a0dddb'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-0507b42b-28bc-4ebb-953d-4b5100c32005" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[144ebfa5-4040-4322-b44e-1a9f1a0b058f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:38 devstack sudo[101775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:08:38 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:38 devstack sudo[101774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005
Nov 05 12:08:38 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:38 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Deleted volume successfully.
Nov 05 12:08:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e5b02572-1655-4323-a100-0d552bded169 tempest-VolumesSnapshotListTestJSON-867576118 None] Lock "cinder-4cc41aa4-7cca-4edf-9fa7-3fed3de5ad84-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:39 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005" returned: 0 in 0.472s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:39 devstack sudo[101782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005
Nov 05 12:08:39 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:39 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0507b42b-28bc-4ebb-953d-4b5100c32005" returned: 0 in 0.292s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-0507b42b-28bc-4ebb-953d-4b5100c32005" released by "delete_volume" :: held 0.815s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Created reservations ['3ec291cb-9dd5-469e-9899-6f7f095a57ad', '7dc8d1ce-3511-497e-b8bd-bc36025c017a', 'd0ee98da-7edb-40ed-97f4-d637b38a138f', 'cb50cd3f-0c59-4dd3-8954-57b423c6b9ca'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:39 devstack sudo[101785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:08:39 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-aa16a732-e61f-49d6-9dd6-cdfee60eef9b-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Lock "cinder-aa16a732-e61f-49d6-9dd6-cdfee60eef9b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-aa16a732-e61f-49d6-9dd6-cdfee60eef9b" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-aa16a732-e61f-49d6-9dd6-cdfee60eef9b" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:39 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.331s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Deleted volume successfully.
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2df9cf-7289-4ed1-a294-6709a89ecaa3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-612cd5ad-f27d-42f9-b3db-ba736a13d7dc tempest-VolumesGetTest-519826712 None] Lock "cinder-0507b42b-28bc-4ebb-953d-4b5100c32005-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:40 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b
Nov 05 12:08:40 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:40 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b" returned: 0 in 0.459s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:40 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b
Nov 05 12:08:40 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:40 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aa16a732-e61f-49d6-9dd6-cdfee60eef9b" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-aa16a732-e61f-49d6-9dd6-cdfee60eef9b" released by "delete_volume" :: held 0.794s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Created reservations ['c30f09fd-f4cd-4ee8-afe9-e1bd91a28be5', '1f10762c-0902-4aad-8e6a-a8e3e9139e1d', 'd8aa1044-7fbf-4322-a4ce-46f30bf3e707', '2068db71-6b6b-439e-945b-3b2d003df02f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:40 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:08:40 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:41 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.287s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:08:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Deleted volume successfully.
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b6f5a52c-c67e-4591-ac01-e023e74df255 tempest-VolumesGetTest-519826712 None] Lock "cinder-aa16a732-e61f-49d6-9dd6-cdfee60eef9b-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (0c275840-242c-45f6-a34d-c44072c1025a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14cf218-77da-427c-a22f-f7fd7d3df267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14cf218-77da-427c-a22f-f7fd7d3df267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1111889393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3debd3f-9b4a-46df-bd68-a21d13381837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:41Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8805357-4458-46e6-9073-b33edaa41496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8805357-4458-46e6-9073-b33edaa41496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b865cc9-76fc-48b6-bbd4-783b77300466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b865cc9-76fc-48b6-bbd4-783b77300466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3debd3f-9b4a-46df-bd68-a21d13381837', 'volume_name': 'volume-b3debd3f-9b4a-46df-bd68-a21d13381837', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0d4381-0abc-4ebc-9b3b-da7078abe431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0d4381-0abc-4ebc-9b3b-da7078abe431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22168d28-0221-4422-998f-1eaac6e9e130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:41 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Volume b3debd3f-9b4a-46df-bd68-a21d13381837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3debd3f-9b4a-46df-bd68-a21d13381837', 'volume_size': 1}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1111889393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3debd3f-9b4a-46df-bd68-a21d13381837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:41Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Creating volume b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:08:41 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:08:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:41 devstack sudo[101799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 1073741824
Nov 05 12:08:41 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:42 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 1073741824" returned: 0 in 0.552s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:42 devstack sudo[101806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837
Nov 05 12:08:42 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:42 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837" returned: 0 in 0.298s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22168d28-0221-4422-998f-1eaac6e9e130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3debd3f-9b4a-46df-bd68-a21d13381837', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278efe18-b0a0-4a46-826c-7df695779009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Volume volume-b3debd3f-9b4a-46df-bd68-a21d13381837 (b3debd3f-9b4a-46df-bd68-a21d13381837): created successfully
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278efe18-b0a0-4a46-826c-7df695779009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (0c275840-242c-45f6-a34d-c44072c1025a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-119ad027-f997-4686-83fb-cf28970f039b tempest-VolumesGetTest-519826712 None] Created volume successfully.
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (ce126a44-baa1-4341-9dd1-96a60c1ed8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47207923-b264-4cec-a5ec-5497cd3d0797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47207923-b264-4cec-a5ec-5497cd3d0797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1056386680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb424a7-27cd-4bcd-9137-e9c50516e165,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b3debd3f-9b4a-46df-bd68-a21d13381837,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:44Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3eb5d3f-5c5a-4ba6-b83d-2dcf9a5956bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3eb5d3f-5c5a-4ba6-b83d-2dcf9a5956bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4f0af6-f8dc-474c-8f3f-9ffac739abd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4f0af6-f8dc-474c-8f3f-9ffac739abd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7fb424a7-27cd-4bcd-9137-e9c50516e165', 'volume_name': 'volume-7fb424a7-27cd-4bcd-9137-e9c50516e165', 'volume_size': 1, 'source_volid': 'b3debd3f-9b4a-46df-bd68-a21d13381837', 'source_volstatus': 'available'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20cba51-a6e1-4644-8aa3-6b71fcae5011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20cba51-a6e1-4644-8aa3-6b71fcae5011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f38144-7956-4ecc-9512-a85c72da59a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:44 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Volume 7fb424a7-27cd-4bcd-9137-e9c50516e165: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7fb424a7-27cd-4bcd-9137-e9c50516e165', 'volume_size': 1, 'source_volid': 'b3debd3f-9b4a-46df-bd68-a21d13381837', 'source_volstatus': 'available'}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:44 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Cloning volume b3debd3f-9b4a-46df-bd68-a21d13381837 to volume 7fb424a7-27cd-4bcd-9137-e9c50516e165
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Creating offline snapshot cd8663e1-eab3-428b-8ed8-91ef2739ac82 of volume b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d994efc4-cb3e-4c34-b364-31ab61d3c33b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:44 devstack sudo[101810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837
Nov 05 12:08:44 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:44 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837" returned: 0 in 0.427s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:44 devstack sudo[101815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 1G
Nov 05 12:08:44 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:45 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 1G" returned: 0 in 0.509s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3debd3f-9b4a-46df-bd68-a21d13381837 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:45 devstack sudo[101820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3debd3f-9b4a-46df-bd68-a21d13381837 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82
Nov 05 12:08:45 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:45 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3debd3f-9b4a-46df-bd68-a21d13381837 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82" returned: 0 in 0.324s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:45 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 is being set with open permissions: ugo+rw
Nov 05 12:08:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:45 devstack sudo[101826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82
Nov 05 12:08:45 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:45 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82" returned: 0 in 0.258s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:45 devstack sudo[101829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.info
Nov 05 12:08:45 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:46 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.info" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:46 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.info is being set with open permissions: ugo+rw
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:46 devstack sudo[101832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.info
Nov 05 12:08:46 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:46 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.info" returned: 0 in 0.243s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-7fb424a7-27cd-4bcd-9137-e9c50516e165" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-7fb424a7-27cd-4bcd-9137-e9c50516e165" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] snapshot: cd8663e1-eab3-428b-8ed8-91ef2739ac82, volume: 7fb424a7-27cd-4bcd-9137-e9c50516e165,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a717029-2709-4b9a-a78f-26c0347f746d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:46 devstack sudo[101835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82
Nov 05 12:08:46 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:46 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82" returned: 0 in 0.450s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3debd3f-9b4a-46df-bd68-a21d13381837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66eb56b-50ca-4589-830a-28e050629102]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:47 devstack sudo[101840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837
Nov 05 12:08:47 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:47 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837" returned: 0 in 0.423s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:08:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:08:47 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:08:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:47 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165
Nov 05 12:08:47 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:55 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165" returned: 0 in 7.628s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837, size 1024.00 MB, duration 7.63 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:08:55 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Converted 1024.00 MB image at 134.22 MB/s
Nov 05 12:08:55 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 is being set with open permissions: ugo+rw
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:55 devstack sudo[101859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165
Nov 05 12:08:55 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:55 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165" returned: 0 in 0.289s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-7fb424a7-27cd-4bcd-9137-e9c50516e165" released by "_copy_volume_from_snapshot" :: held 8.897s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-cd8663e1-eab3-428b-8ed8-91ef2739ac82" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-cd8663e1-eab3-428b-8ed8-91ef2739ac82" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Deleting offline snapshot cd8663e1-eab3-428b-8ed8-91ef2739ac82 of volume b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] snapshot_file for this snap is: volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6cfb4f-14bf-45a2-9cbc-8fdb419b9670]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:55 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82
Nov 05 12:08:55 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=61,cinder:UPDATE=72,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:08:55 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82" returned: 0 in 0.503s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3debd3f-9b4a-46df-bd68-a21d13381837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb6107e-d374-44fc-8fc4-e79027fbf51c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:08:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:56 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837
Nov 05 12:08:56 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:56 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837" returned: 0 in 0.654s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:56 devstack sudo[101874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82
Nov 05 12:08:56 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:57 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82" returned: 0 in 0.431s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:57 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82
Nov 05 12:08:57 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:57 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837.cd8663e1-eab3-428b-8ed8-91ef2739ac82" returned: 0 in 0.309s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-cd8663e1-eab3-428b-8ed8-91ef2739ac82" released by "_delete_snapshot" :: held 2.037s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.187s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f38144-7956-4ecc-9512-a85c72da59a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb424a7-27cd-4bcd-9137-e9c50516e165', 'volume_size': 1, 'source_volid': 'b3debd3f-9b4a-46df-bd68-a21d13381837', 'source_volstatus': 'available'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc51851-2a64-4106-8ea5-076dfa2cf9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Volume volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 (7fb424a7-27cd-4bcd-9137-e9c50516e165): created successfully
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc51851-2a64-4106-8ea5-076dfa2cf9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (ce126a44-baa1-4341-9dd1-96a60c1ed8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-02f49f07-6aa7-4659-a47b-6ca2c92084b7 tempest-VolumesGetTest-519826712 None] Created volume successfully.
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (816c5dad-d0af-4150-bb03-1c627a42f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77f551c-a4a3-4a9e-a100-da256f50062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77f551c-a4a3-4a9e-a100-da256f50062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-486327594',display_name='tempest-VolumesGetTest-Volume-585948727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb7c811-e590-4224-8aa7-c062aafeba8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:59Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9e39c9-5e8b-4da6-9b49-b5a994166c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9e39c9-5e8b-4da6-9b49-b5a994166c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c37822-9a71-4c6e-9ca7-0bcc53368d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c37822-9a71-4c6e-9ca7-0bcc53368d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb7c811-e590-4224-8aa7-c062aafeba8e', 'volume_name': 'volume-afb7c811-e590-4224-8aa7-c062aafeba8e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824bbe8b-ab8a-42c9-a3f4-cd7490e10ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824bbe8b-ab8a-42c9-a3f4-cd7490e10ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ad35f7-7f50-4254-b992-2896e5c74f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:08:59 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Volume afb7c811-e590-4224-8aa7-c062aafeba8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb7c811-e590-4224-8aa7-c062aafeba8e', 'volume_size': 1}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:08:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-486327594',display_name='tempest-VolumesGetTest-Volume-585948727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb7c811-e590-4224-8aa7-c062aafeba8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:08:59Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Creating volume afb7c811-e590-4224-8aa7-c062aafeba8e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:08:59 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:59 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e 1073741824
Nov 05 12:08:59 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:08:59 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e 1073741824" returned: 0 in 0.522s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:08:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:08:59 devstack sudo[101895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e
Nov 05 12:08:59 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:00 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e" returned: 0 in 0.294s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ad35f7-7f50-4254-b992-2896e5c74f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb7c811-e590-4224-8aa7-c062aafeba8e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67c6e12-c547-421e-8b47-6b5a6b52629b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:00 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Volume volume-afb7c811-e590-4224-8aa7-c062aafeba8e (afb7c811-e590-4224-8aa7-c062aafeba8e): created successfully
Nov 05 12:09:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67c6e12-c547-421e-8b47-6b5a6b52629b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (816c5dad-d0af-4150-bb03-1c627a42f308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:00 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-30798294-b478-47db-9c24-3422a61fed51 tempest-VolumesGetTest-519826712 None] Created volume successfully.
Nov 05 12:09:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-afb7c811-e590-4224-8aa7-c062aafeba8e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Lock "cinder-afb7c811-e590-4224-8aa7-c062aafeba8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-afb7c811-e590-4224-8aa7-c062aafeba8e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-afb7c811-e590-4224-8aa7-c062aafeba8e" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:01 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8afb2c0-73bb-4452-b182-19ca22352aec]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:01 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e
Nov 05 12:09:01 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:02 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e" returned: 0 in 0.461s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:02 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e
Nov 05 12:09:02 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:02 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-afb7c811-e590-4224-8aa7-c062aafeba8e" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-afb7c811-e590-4224-8aa7-c062aafeba8e" released by "delete_volume" :: held 0.810s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Created reservations ['c234f348-b409-40f5-8489-ed19c4d75307', 'c53a14d7-2e2e-4241-bd89-d835a11aa5f4', 'c75aeec2-5e4a-4249-9e28-982b8aa00d20', 'dbec7b37-ad8f-4530-aacd-0b1f89f789a4'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:02 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:02 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-7fb424a7-27cd-4bcd-9137-e9c50516e165-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Lock "cinder-7fb424a7-27cd-4bcd-9137-e9c50516e165-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-7fb424a7-27cd-4bcd-9137-e9c50516e165" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-7fb424a7-27cd-4bcd-9137-e9c50516e165" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff756bb6-7231-4805-8b9d-134fab1935ea]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:02 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Deleted volume successfully.
Nov 05 12:09:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cec21d67-1edd-4e3f-8dbb-249100176ec9 tempest-VolumesGetTest-519826712 None] Lock "cinder-afb7c811-e590-4224-8aa7-c062aafeba8e-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:03 devstack sudo[101909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165
Nov 05 12:09:03 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:03 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165" returned: 0 in 0.512s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:03 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165
Nov 05 12:09:03 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:03 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7fb424a7-27cd-4bcd-9137-e9c50516e165" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-7fb424a7-27cd-4bcd-9137-e9c50516e165" released by "delete_volume" :: held 0.844s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Created reservations ['bf2dfd17-8dd1-4d34-b916-cc8e647f2b67', 'f313dddc-1c6e-4dbb-807c-704e3b95aedd', '2d9c8a19-dee4-411c-8ae2-ba5dd5df9709', '08e531c5-9317-4fac-a700-a4f69b4f5915'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:03 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:03 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-b3debd3f-9b4a-46df-bd68-a21d13381837-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Lock "cinder-b3debd3f-9b4a-46df-bd68-a21d13381837-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-b3debd3f-9b4a-46df-bd68-a21d13381837" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-b3debd3f-9b4a-46df-bd68-a21d13381837" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:04 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.405s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Deleted volume successfully.
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f5f6ed-e857-48be-a082-30cb9880fe34]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e6379e27-3d24-47fd-8520-097e64875249 tempest-VolumesGetTest-519826712 None] Lock "cinder-7fb424a7-27cd-4bcd-9137-e9c50516e165-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:04 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837
Nov 05 12:09:04 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:04 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837" returned: 0 in 0.395s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:04 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837
Nov 05 12:09:04 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:04 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b3debd3f-9b4a-46df-bd68-a21d13381837" returned: 0 in 0.317s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-b3debd3f-9b4a-46df-bd68-a21d13381837" released by "delete_volume" :: held 0.797s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Created reservations ['249ab21a-73ae-4b28-9648-a0b2dc0e3ec6', '06c05d04-0bc2-4eef-ba8d-b2c899ad9e90', '68f11b73-e455-4177-8412-0c8a70ded7e2', '93b242d8-a6af-4625-a824-b19422d188a3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:05 devstack sudo[101929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:05 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:05 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Deleted volume successfully.
Nov 05 12:09:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5691b612-ecb8-400f-a783-1276d01b8426 tempest-VolumesGetTest-519826712 None] Lock "cinder-b3debd3f-9b4a-46df-bd68-a21d13381837-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (52deb6c4-c3e5-4c08-9bf8-d5bfb56c2d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb9b98d-77ad-446d-8a21-f5102f906fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb9b98d-77ad-446d-8a21-f5102f906fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2076701982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bdd67b-ebe4-4298-b794-b0ddab091ae6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:06Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045d157d-c5ff-4b11-95cf-e8a6e389d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045d157d-c5ff-4b11-95cf-e8a6e389d829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a677b0d-fa7b-444c-97ce-d2f6f31ebcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a677b0d-fa7b-444c-97ce-d2f6f31ebcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53bdd67b-ebe4-4298-b794-b0ddab091ae6', 'volume_name': 'volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01eab1b50>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb971684-4941-4dd5-8490-51b59a31ddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb971684-4941-4dd5-8490-51b59a31ddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b5d19-0d22-4d44-9abe-01474225c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Volume 53bdd67b-ebe4-4298-b794-b0ddab091ae6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01eab1b50>}
Nov 05 12:09:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Trying to clone 53bdd67b-ebe4-4298-b794-b0ddab091ae6 from image 71120f13-1140-4938-836f-6085e103efeb at location (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:09:07 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42e299a-644b-4c7d-935c-cc7712418930]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:07 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD
Nov 05 12:09:07 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Flow 'volume_create_manager' (af823b9c-002f-4785-9465-e08f4c33d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2290080-9c4d-455f-94b2-4bd3171a650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2290080-9c4d-455f-94b2-4bd3171a650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1653419886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddbbbf3-3b55-4e00-817b-047cbeba9398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111056cd87834548a8be40de370e6b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:07Z,use_quota=True,user_id='842371cf2a1549efa1ed30c48dcb033b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c6e8b6-6746-4fdb-94bd-ec9673d2f922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c6e8b6-6746-4fdb-94bd-ec9673d2f922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea503e04-5a45-4faa-ae87-c8415dcb602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea503e04-5a45-4faa-ae87-c8415dcb602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddbbbf3-3b55-4e00-817b-047cbeba9398', 'volume_name': 'volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80da42bc-7345-45a7-bb47-581deed20c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80da42bc-7345-45a7-bb47-581deed20c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f9a7ce-901a-4477-9d21-6cec48aa9664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:07 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Volume 4ddbbbf3-3b55-4e00-817b-047cbeba9398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398', 'volume_size': 1}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1653419886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddbbbf3-3b55-4e00-817b-047cbeba9398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111056cd87834548a8be40de370e6b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:07Z,use_quota=True,user_id='842371cf2a1549efa1ed30c48dcb033b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Creating volume 4ddbbbf3-3b55-4e00-817b-047cbeba9398 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:07 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:07 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 1073741824
Nov 05 12:09:07 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:07 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb is fetched for user 0a3fade8d5a1460b9f6bed83b7b6c953. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbe48f4-607f-4133-880a-ad2878972913]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:07 devstack sudo[101940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD
Nov 05 12:09:07 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:07 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 1073741824" returned: 0 in 0.464s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:08 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:08 devstack sudo[101948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398
Nov 05 12:09:08 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:08 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398" returned: 0 in 0.245s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2076701982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bdd67b-ebe4-4298-b794-b0ddab091ae6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:06Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Creating volume 53bdd67b-ebe4-4298-b794-b0ddab091ae6 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:08 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f9a7ce-901a-4477-9d21-6cec48aa9664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9474ab78-5c86-443f-a027-bf0e77f37115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:08 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 1073741824
Nov 05 12:09:08 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:08 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Volume volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 (4ddbbbf3-3b55-4e00-817b-047cbeba9398): created successfully
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9474ab78-5c86-443f-a027-bf0e77f37115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Flow 'volume_create_manager' (af823b9c-002f-4785-9465-e08f4c33d530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:08 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c93ee017-4dfc-48c9-9775-cd0c5924f3bb tempest-TestImageHashVerification-1215390493 None] Created volume successfully.
Nov 05 12:09:08 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 1073741824" returned: 0 in 0.457s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:08 devstack sudo[101956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6
Nov 05 12:09:08 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:09 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6" returned: 0 in 0.249s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Attempting download of 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume 53bdd67b-ebe4-4298-b794-b0ddab091ae6. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[28200cc2-cc4a-4ad4-af79-6b41cc3bbf2b]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_rs26pzaf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:09 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_rs26pzaf
Nov 05 12:09:09 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:09 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_rs26pzaf" returned: 0 in 0.323s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_rs26pzaf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:09 devstack sudo[101963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_rs26pzaf
Nov 05 12:09:09 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:09 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_rs26pzaf" returned: 1 in 0.330s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71120f13-1140-4938-836f-6085e103efeb_rs26pzaf' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddb9887-b827-4d89-ad49-83006b93bd09]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:09 devstack sudo[101967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD
Nov 05 12:09:09 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:10 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] 71120f13-1140-4938-836f-6085e103efeb was qcow2, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:10 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6
Nov 05 12:09:10 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eec74a-9dca-470a-b49a-9880dafc6a1f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:10 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398
Nov 05 12:09:10 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:10 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398" returned: 0 in 0.392s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4daa598-159f-4ff4-92ab-582d5657c94d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:10 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398
Nov 05 12:09:10 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:11 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398" returned: 0 in 0.450s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 /opt/stack/data/cinder/conversion/4ddbbbf3-3b55-4e00-817b-047cbeba9398.temp_image.8cdf6688-a1bf-4467-8389-042450356ce286isvfpc.img {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:11 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 /opt/stack/data/cinder/conversion/4ddbbbf3-3b55-4e00-817b-047cbeba9398.temp_image.8cdf6688-a1bf-4467-8389-042450356ce286isvfpc.img
Nov 05 12:09:11 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:12 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6" returned: 0 in 2.458s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:12 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71120f13-1140-4938-836f-6085e103efeb_ii1zd6kzdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:09:12 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Converted 112.00 MB image at 45.55 MB/s
Nov 05 12:09:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:12 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 1G
Nov 05 12:09:12 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:13 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 1G" returned: 0 in 0.591s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Downloaded image 71120f13-1140-4938-836f-6085e103efeb ((None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}])) to volume 53bdd67b-ebe4-4298-b794-b0ddab091ae6 successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Temporary image 71120f13-1140-4938-836f-6085e103efeb for user 0a3fade8d5a1460b9f6bed83b7b6c953 is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Marking volume 53bdd67b-ebe4-4298-b794-b0ddab091ae6 as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Copying metadata from image 71120f13-1140-4938-836f-6085e103efeb to 53bdd67b-ebe4-4298-b794-b0ddab091ae6. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Creating volume glance metadata for volume 53bdd67b-ebe4-4298-b794-b0ddab091ae6 backed by image 71120f13-1140-4938-836f-6085e103efeb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b5d19-0d22-4d44-9abe-01474225c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6', 'volume_size': 1, 'image_id': '71120f13-1140-4938-836f-6085e103efeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71120f13-1140-4938-836f-6085e103efeb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b0e6858d1e7412bbd4bde921fcbcc62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71120f13-1140-4938-836f-6085e103efeb', 'created_at': datetime.datetime(2026, 11, 5, 10, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71120f13-1140-4938-836f-6085e103efeb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd01eab1b50>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5181d37c-a18f-446b-a1b7-64be523728c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:13 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Volume volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 (53bdd67b-ebe4-4298-b794-b0ddab091ae6): created successfully
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5181d37c-a18f-446b-a1b7-64be523728c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (52deb6c4-c3e5-4c08-9bf8-d5bfb56c2d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:13 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-546082f6-b037-4408-90ea-e06cf466efd3 tempest-VolumesGetTest-519826712 None] Created volume successfully.
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:13 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:13 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:14 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.493s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:09:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:09:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (d275a7cf-a4ff-4156-b69d-687f81ad9700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6059ba0-2a90-417f-9b57-c9854795c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6059ba0-2a90-417f-9b57-c9854795c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673091266',display_name='tempest-VolumesGetTest-Volume-1516925727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf356e3-4d63-4548-a939-9bf599d20056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:15Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb44d89-adfe-421f-8752-acc90d01a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb44d89-adfe-421f-8752-acc90d01a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0923c02-03a1-4db4-83f8-dc56f6261f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0923c02-03a1-4db4-83f8-dc56f6261f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf356e3-4d63-4548-a939-9bf599d20056', 'volume_name': 'volume-9bf356e3-4d63-4548-a939-9bf599d20056', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d84d4f-5bc5-4685-8149-4782947f6659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d84d4f-5bc5-4685-8149-4782947f6659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043b9fbb-9021-4c4f-ba2b-11933515f695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:15 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Volume 9bf356e3-4d63-4548-a939-9bf599d20056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf356e3-4d63-4548-a939-9bf599d20056', 'volume_size': 1}
Nov 05 12:09:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:17 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 /opt/stack/data/cinder/conversion/4ddbbbf3-3b55-4e00-817b-047cbeba9398.temp_image.8cdf6688-a1bf-4467-8389-042450356ce286isvfpc.img" returned: 0 in 6.323s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:17 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac741314-7232-4f10-9c81-a1e990294760]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:17 devstack sudo[102050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398
Nov 05 12:09:17 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:18 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398" returned: 0 in 0.567s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:18 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/conversion/4ddbbbf3-3b55-4e00-817b-047cbeba9398.temp_image.8cdf6688-a1bf-4467-8389-042450356ce286isvfpc.img {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:09:18 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Converted 1024.00 MB image at 161.93 MB/s
Nov 05 12:09:18 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] 8cdf6688-a1bf-4467-8389-042450356ce2 was raw, no need to convert to raw {{(pid=87317) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 12:09:25 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=80,cinder:INSERT=33,cinder:UPDATE=100,cinder:DELETE=14 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:28 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=34,cinder:SELECT=35,cinder:INSERT=15,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.703s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Uploaded volume to glance image-id: 8cdf6688-a1bf-4467-8389-042450356ce2. {{(pid=87317) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.758s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673091266',display_name='tempest-VolumesGetTest-Volume-1516925727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf356e3-4d63-4548-a939-9bf599d20056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5d7c3903e43a0998879c9ec585e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:15Z,use_quota=True,user_id='0a3fade8d5a1460b9f6bed83b7b6c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Creating volume 9bf356e3-4d63-4548-a939-9bf599d20056 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:37 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056 1073741824
Nov 05 12:09:37 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f1c66eba-e9aa-40cc-8e81-caee11efd5af tempest-TestImageHashVerification-1215390493 None] Copy volume to image completed successfully.
Nov 05 12:09:37 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056 1073741824" returned: 0 in 0.482s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:37 devstack sudo[102066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056
Nov 05 12:09:37 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:37 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043b9fbb-9021-4c4f-ba2b-11933515f695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf356e3-4d63-4548-a939-9bf599d20056', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cabfb1-f966-41a3-8925-7d5ba0f2afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Volume volume-9bf356e3-4d63-4548-a939-9bf599d20056 (9bf356e3-4d63-4548-a939-9bf599d20056): created successfully
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cabfb1-f966-41a3-8925-7d5ba0f2afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Flow 'volume_create_manager' (d275a7cf-a4ff-4156-b69d-687f81ad9700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-22e93d21-7c5b-4ed3-8ebe-3045ea74c6e9 tempest-VolumesGetTest-519826712 None] Created volume successfully.
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Acquiring lock "cinder-4ddbbbf3-3b55-4e00-817b-047cbeba9398-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Lock "cinder-4ddbbbf3-3b55-4e00-817b-047cbeba9398-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Acquiring lock "cinder-quobyte-4ddbbbf3-3b55-4e00-817b-047cbeba9398" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Lock "cinder-quobyte-4ddbbbf3-3b55-4e00-817b-047cbeba9398" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[066432d3-3b27-4dd5-8da2-248678ece467]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:38 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398
Nov 05 12:09:38 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:38 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398" returned: 0 in 0.360s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:38 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398
Nov 05 12:09:38 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:38 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4ddbbbf3-3b55-4e00-817b-047cbeba9398" returned: 0 in 0.260s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Lock "cinder-quobyte-4ddbbbf3-3b55-4e00-817b-047cbeba9398" released by "delete_volume" :: held 0.659s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-9bf356e3-4d63-4548-a939-9bf599d20056-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Lock "cinder-9bf356e3-4d63-4548-a939-9bf599d20056-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Created reservations ['7f1767ef-704c-4679-ba28-a28b27e34451', '45c1503f-a587-41a9-aabd-1096faf264ac', 'fa45cdde-b985-43de-b741-250e7d0d34f0', 'b8439b68-739f-40eb-8555-ba45ed77073b'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-9bf356e3-4d63-4548-a939-9bf599d20056" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-9bf356e3-4d63-4548-a939-9bf599d20056" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae72bd66-2ecf-45c0-b841-a23ddc316906]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:38 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:38 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:38 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056
Nov 05 12:09:38 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:39 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.302s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Deleted volume successfully.
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d6d7e663-798a-4abe-8c72-4a7a3efe83ce tempest-TestImageHashVerification-1215390493 None] Lock "cinder-4ddbbbf3-3b55-4e00-817b-047cbeba9398-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:39 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056" returned: 0 in 0.425s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:39 devstack sudo[102085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056
Nov 05 12:09:39 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:39 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9bf356e3-4d63-4548-a939-9bf599d20056" returned: 0 in 0.246s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-9bf356e3-4d63-4548-a939-9bf599d20056" released by "delete_volume" :: held 0.719s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Created reservations ['dfe632ea-418f-47f3-8718-ccb095c70b0e', '56a9b1e1-6e6b-4493-ad10-5ba955fcdf85', 'a5fc98a6-e6af-46ee-9fb8-5c763f1c45a9', '810e8d9d-fd6c-4393-a495-127f2abd81b6'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:39 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:39 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:39 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-53bdd67b-ebe4-4298-b794-b0ddab091ae6-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.320s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:39 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Deleted volume successfully.
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Lock "cinder-53bdd67b-ebe4-4298-b794-b0ddab091ae6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7904d9c0-f05c-4b61-a3e4-ded1249f68ac tempest-VolumesGetTest-519826712 None] Lock "cinder-9bf356e3-4d63-4548-a939-9bf599d20056-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Acquiring lock "cinder-quobyte-53bdd67b-ebe4-4298-b794-b0ddab091ae6" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-53bdd67b-ebe4-4298-b794-b0ddab091ae6" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b8bd2-cf77-4959-aa01-2ed466a512d9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:40 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6
Nov 05 12:09:40 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:40 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6" returned: 0 in 0.370s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:40 devstack sudo[102096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6
Nov 05 12:09:40 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:40 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-53bdd67b-ebe4-4298-b794-b0ddab091ae6" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Lock "cinder-quobyte-53bdd67b-ebe4-4298-b794-b0ddab091ae6" released by "delete_volume" :: held 0.697s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Created reservations ['f1fa0335-8dae-471f-8fcf-befbcdaac2b5', '1d021d40-c32c-4950-af79-040d0dec30a7', '58dc6e04-5687-4790-bc76-bba2a6be734d', '4245fe00-3e0d-4b58-8b63-30f03eee1c75'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:40 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:40 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:41 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.271s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:41 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Deleted volume successfully.
Nov 05 12:09:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8edc6039-ff3a-471f-8573-e3c85f8026d6 tempest-VolumesGetTest-519826712 None] Lock "cinder-53bdd67b-ebe4-4298-b794-b0ddab091ae6-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Flow 'volume_create_manager' (76fa506a-2de0-4281-b796-c9d1714bd4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcbf8b8-8ee9-4c76-97d5-17fc5fc6e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcbf8b8-8ee9-4c76-97d5-17fc5fc6e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1896049954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9501a0d0-b8a9-479b-a843-36d36ba2b742,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a17addb120649fda5ce439a3c880ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:45Z,use_quota=True,user_id='5be60775e6404d43bf6bacd9adaa1a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31480dbe-b404-4dc0-992e-0600196eb134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31480dbe-b404-4dc0-992e-0600196eb134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887c7ab7-d53f-4549-b878-1205e8ee33e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887c7ab7-d53f-4549-b878-1205e8ee33e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9501a0d0-b8a9-479b-a843-36d36ba2b742', 'volume_name': 'volume-9501a0d0-b8a9-479b-a843-36d36ba2b742', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b50e24-51ab-40ed-af92-022097f3209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b50e24-51ab-40ed-af92-022097f3209c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b31fe2-0346-41be-845a-56f01e17c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:45 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Volume 9501a0d0-b8a9-479b-a843-36d36ba2b742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9501a0d0-b8a9-479b-a843-36d36ba2b742', 'volume_size': 1}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1896049954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9501a0d0-b8a9-479b-a843-36d36ba2b742,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a17addb120649fda5ce439a3c880ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:45Z,use_quota=True,user_id='5be60775e6404d43bf6bacd9adaa1a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Creating volume 9501a0d0-b8a9-479b-a843-36d36ba2b742 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:45 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:45 devstack sudo[102107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742 1073741824
Nov 05 12:09:45 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:45 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742 1073741824" returned: 0 in 0.465s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:45 devstack sudo[102113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742
Nov 05 12:09:45 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:46 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b31fe2-0346-41be-845a-56f01e17c565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9501a0d0-b8a9-479b-a843-36d36ba2b742', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137fa134-9f72-407c-9818-04de49edcba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:46 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Volume volume-9501a0d0-b8a9-479b-a843-36d36ba2b742 (9501a0d0-b8a9-479b-a843-36d36ba2b742): created successfully
Nov 05 12:09:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137fa134-9f72-407c-9818-04de49edcba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Flow 'volume_create_manager' (76fa506a-2de0-4281-b796-c9d1714bd4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9625eb85-3e71-4c95-8eb6-51b48242c8a2 tempest-VolumesListTestJSON-732376190 None] Created volume successfully.
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Flow 'volume_create_manager' (1f0f120d-5e54-450a-8764-6e933af61841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7690ed7d-cee5-4068-b3a9-040cf434755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7690ed7d-cee5-4068-b3a9-040cf434755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1632585575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10a61ad-84d2-4f4b-b534-fc2c75356dbd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a17addb120649fda5ce439a3c880ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:48Z,use_quota=True,user_id='5be60775e6404d43bf6bacd9adaa1a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9205f063-3a30-4528-9aac-2999756fa39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9205f063-3a30-4528-9aac-2999756fa39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69582906-34a2-4117-8415-2d3792f5b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69582906-34a2-4117-8415-2d3792f5b53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10a61ad-84d2-4f4b-b534-fc2c75356dbd', 'volume_name': 'volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f36e1d-21bf-4345-ac52-3f0388c82f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f36e1d-21bf-4345-ac52-3f0388c82f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbfe92e-af13-436c-82ca-c96173bc2c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:48 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Volume c10a61ad-84d2-4f4b-b534-fc2c75356dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd', 'volume_size': 1}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1632585575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10a61ad-84d2-4f4b-b534-fc2c75356dbd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a17addb120649fda5ce439a3c880ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:48Z,use_quota=True,user_id='5be60775e6404d43bf6bacd9adaa1a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Creating volume c10a61ad-84d2-4f4b-b534-fc2c75356dbd {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:48 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:48 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd 1073741824
Nov 05 12:09:48 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:48 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd 1073741824" returned: 0 in 0.516s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:48 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd
Nov 05 12:09:48 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:49 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd" returned: 0 in 0.285s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbfe92e-af13-436c-82ca-c96173bc2c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37260b56-5c7e-444f-aad3-50192bd99917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:49 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Volume volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd (c10a61ad-84d2-4f4b-b534-fc2c75356dbd): created successfully
Nov 05 12:09:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37260b56-5c7e-444f-aad3-50192bd99917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Flow 'volume_create_manager' (1f0f120d-5e54-450a-8764-6e933af61841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0620fbe2-4c62-4480-b659-ce4bcb0d921b tempest-VolumesListTestJSON-732376190 None] Created volume successfully.
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Flow 'volume_create_manager' (22c19fc5-02ec-45b9-b30a-2712f90c0932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46f260b-749a-446c-956b-7e17e2dc20bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46f260b-749a-446c-956b-7e17e2dc20bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-917084746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f95170f-d857-4879-993e-9778dd56be62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a17addb120649fda5ce439a3c880ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:51Z,use_quota=True,user_id='5be60775e6404d43bf6bacd9adaa1a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cf1baa-c9f6-4af7-81fa-47e708933c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cf1baa-c9f6-4af7-81fa-47e708933c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdd60fc-56db-48bc-b6ad-2fa464acdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdd60fc-56db-48bc-b6ad-2fa464acdca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f95170f-d857-4879-993e-9778dd56be62', 'volume_name': 'volume-1f95170f-d857-4879-993e-9778dd56be62', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e203fd26-0b8e-42fb-b8da-cafc9e76b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e203fd26-0b8e-42fb-b8da-cafc9e76b68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d39efd-cb6e-4fa2-afb7-1dd6716727a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:50 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Volume 1f95170f-d857-4879-993e-9778dd56be62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f95170f-d857-4879-993e-9778dd56be62', 'volume_size': 1}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-917084746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f95170f-d857-4879-993e-9778dd56be62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a17addb120649fda5ce439a3c880ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:09:51Z,use_quota=True,user_id='5be60775e6404d43bf6bacd9adaa1a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Creating volume 1f95170f-d857-4879-993e-9778dd56be62 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:09:50 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:09:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:51 devstack sudo[102126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62 1073741824
Nov 05 12:09:51 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:51 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62 1073741824" returned: 0 in 0.473s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:51 devstack sudo[102132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62
Nov 05 12:09:51 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:51 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d39efd-cb6e-4fa2-afb7-1dd6716727a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f95170f-d857-4879-993e-9778dd56be62', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc120c74-5b49-42b4-bce0-28575c23dbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:09:51 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Volume volume-1f95170f-d857-4879-993e-9778dd56be62 (1f95170f-d857-4879-993e-9778dd56be62): created successfully
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc120c74-5b49-42b4-bce0-28575c23dbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:09:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Flow 'volume_create_manager' (22c19fc5-02ec-45b9-b30a-2712f90c0932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:09:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bc302f10-9671-468d-9d6a-68ce3ab650e5 tempest-VolumesListTestJSON-732376190 None] Created volume successfully.
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Acquiring lock "cinder-1f95170f-d857-4879-993e-9778dd56be62-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Lock "cinder-1f95170f-d857-4879-993e-9778dd56be62-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Acquiring lock "cinder-quobyte-1f95170f-d857-4879-993e-9778dd56be62" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Lock "cinder-quobyte-1f95170f-d857-4879-993e-9778dd56be62" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a960d3-ffb4-427f-b965-6205262800a3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:55 devstack sudo[102136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62
Nov 05 12:09:55 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:55 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:55 devstack sudo[102141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62
Nov 05 12:09:55 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:55 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f95170f-d857-4879-993e-9778dd56be62" returned: 0 in 0.243s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Lock "cinder-quobyte-1f95170f-d857-4879-993e-9778dd56be62" released by "delete_volume" :: held 0.676s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Created reservations ['0f650dd2-0b04-4bf8-8b42-6b7adf4bf551', '3fcb3618-2028-4456-9d4c-c25081b25a85', '814cfa4d-2e32-4c8a-b422-5cc0a0398db9', '46305640-15c2-4262-8238-6479cc4ab6de'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:55 devstack sudo[102144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:55 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:56 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Deleted volume successfully.
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cfbf0cdf-8f8f-46dc-b01c-e8e731806f7b tempest-VolumesListTestJSON-732376190 None] Lock "cinder-1f95170f-d857-4879-993e-9778dd56be62-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Acquiring lock "cinder-c10a61ad-84d2-4f4b-b534-fc2c75356dbd-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Lock "cinder-c10a61ad-84d2-4f4b-b534-fc2c75356dbd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Acquiring lock "cinder-quobyte-c10a61ad-84d2-4f4b-b534-fc2c75356dbd" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Lock "cinder-quobyte-c10a61ad-84d2-4f4b-b534-fc2c75356dbd" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca555f-845d-41f5-9c84-8a938539e92a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:56 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd
Nov 05 12:09:56 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:56 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd" returned: 0 in 0.432s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:56 devstack sudo[102153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd
Nov 05 12:09:56 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:57 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c10a61ad-84d2-4f4b-b534-fc2c75356dbd" returned: 0 in 0.289s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Lock "cinder-quobyte-c10a61ad-84d2-4f4b-b534-fc2c75356dbd" released by "delete_volume" :: held 0.771s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Created reservations ['ebfbc1b5-d386-4a42-90b6-58e09d27f8b7', 'ad29db20-ca6f-4d88-9e20-757c985a0974', 'ba441f3b-89e0-4b3e-8715-026628d9a388', '5c184ec5-3d6d-4ddd-9da5-a13be420a5ff'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:57 devstack sudo[102162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:57 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Acquiring lock "cinder-9501a0d0-b8a9-479b-a843-36d36ba2b742-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Lock "cinder-9501a0d0-b8a9-479b-a843-36d36ba2b742-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:57 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.318s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Deleted volume successfully.
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Acquiring lock "cinder-quobyte-9501a0d0-b8a9-479b-a843-36d36ba2b742" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1fb4270a-79e1-4d67-b575-b7bc4314c79c tempest-VolumesListTestJSON-732376190 None] Lock "cinder-c10a61ad-84d2-4f4b-b534-fc2c75356dbd-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Lock "cinder-quobyte-9501a0d0-b8a9-479b-a843-36d36ba2b742" acquired by "delete_volume" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b672b2fc-adfa-40ac-825a-6e35ef5b2df2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:09:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:57 devstack sudo[102165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742
Nov 05 12:09:57 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:58 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742" returned: 0 in 0.416s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:58 devstack sudo[102172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742
Nov 05 12:09:58 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:58 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-9501a0d0-b8a9-479b-a843-36d36ba2b742" returned: 0 in 0.300s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Lock "cinder-quobyte-9501a0d0-b8a9-479b-a843-36d36ba2b742" released by "delete_volume" :: held 0.769s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Created reservations ['7738a6e9-ad3f-4a0a-a744-b312b9e0df85', '26e0246d-575b-4f66-8586-70d3d66dd2db', '3b2caf38-e2d9-475e-a8d2-1d691f5384ef', 'f3d5ac7b-9378-470c-a6d7-739dd39bb92a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:09:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:09:58 devstack sudo[102175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:09:58 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:09:59 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root
Nov 05 12:09:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.336s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:09:59 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:09:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Deleted volume successfully.
Nov 05 12:09:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-271d22c9-4a81-4a3e-acd7-303118fa1bf3 tempest-VolumesListTestJSON-732376190 None] Lock "cinder-9501a0d0-b8a9-479b-a843-36d36ba2b742-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Flow 'volume_create_manager' (4e030b2b-43ce-4527-81de-6532c782c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea46bf9-6d24-49b8-9029-2f80064c8504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea46bf9-6d24-49b8-9029-2f80064c8504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-636544960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc76417e-4423-409e-885a-ff7ffb9f1802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db64c90a40446aab6a35d5922b960fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:03Z,use_quota=True,user_id='1766ab0b597a40cdaa8d101b8412f6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04d7d08-102e-44b5-9d6f-0c656732d781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04d7d08-102e-44b5-9d6f-0c656732d781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627b38ec-0924-4322-ac53-aa19c00a89a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627b38ec-0924-4322-ac53-aa19c00a89a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc76417e-4423-409e-885a-ff7ffb9f1802', 'volume_name': 'volume-bc76417e-4423-409e-885a-ff7ffb9f1802', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd94d610-6e1c-4c80-8db5-45a917f62788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd94d610-6e1c-4c80-8db5-45a917f62788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb145f61-6528-4cf3-b450-53da9739b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Volume bc76417e-4423-409e-885a-ff7ffb9f1802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc76417e-4423-409e-885a-ff7ffb9f1802', 'volume_size': 1}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-636544960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc76417e-4423-409e-885a-ff7ffb9f1802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db64c90a40446aab6a35d5922b960fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:03Z,use_quota=True,user_id='1766ab0b597a40cdaa8d101b8412f6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Creating volume bc76417e-4423-409e-885a-ff7ffb9f1802 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:10:03 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:03 devstack sudo[102180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802 1073741824
Nov 05 12:10:03 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:03 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802 1073741824" returned: 0 in 0.544s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:04 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802
Nov 05 12:10:04 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:04 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802" returned: 0 in 0.354s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb145f61-6528-4cf3-b450-53da9739b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc76417e-4423-409e-885a-ff7ffb9f1802', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c0f662-474d-46c7-adb6-034d8e965d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:04 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Volume volume-bc76417e-4423-409e-885a-ff7ffb9f1802 (bc76417e-4423-409e-885a-ff7ffb9f1802): created successfully
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c0f662-474d-46c7-adb6-034d8e965d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Flow 'volume_create_manager' (4e030b2b-43ce-4527-81de-6532c782c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:10:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-436d2642-9ea0-42e8-acb0-8c422e420f17 tempest-VolumesNegativeTest-1552271448 None] Created volume successfully.
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:13 devstack sudo[102250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:10:13 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:13 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.322s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:10:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:10:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:10:14 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=66,cinder:SELECT=42,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:14 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=38,cinder:UPDATE=61,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Flow 'volume_create_manager' (d5f4f11e-6a03-43bb-a479-bf612648670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8efc1e-b340-4bc0-bda0-5c6d776c1c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8efc1e-b340-4bc0-bda0-5c6d776c1c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-426053905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04af0ab9760742ac9c580784a0a58ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:20Z,use_quota=True,user_id='a9d4054f28d84dd99f178a03e378bbfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d42ab89-be3a-4d15-a831-d4eb5dc4dcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d42ab89-be3a-4d15-a831-d4eb5dc4dcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3933443-ac7b-40af-bc64-61a43134112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3933443-ac7b-40af-bc64-61a43134112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3', 'volume_name': 'volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423bbfb9-4570-4602-9e97-a81fa42c1f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423bbfb9-4570-4602-9e97-a81fa42c1f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0af78a-d5cd-4926-b7ab-26311e66e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:19 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Volume 22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3', 'volume_size': 1}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-426053905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04af0ab9760742ac9c580784a0a58ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:10:20Z,use_quota=True,user_id='a9d4054f28d84dd99f178a03e378bbfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Creating volume 22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:10:19 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:10:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:19 devstack sudo[102324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 1073741824
Nov 05 12:10:19 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:20 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 1073741824" returned: 0 in 0.684s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:20 devstack sudo[102350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3
Nov 05 12:10:20 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:21 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" returned: 0 in 0.381s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:10:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0af78a-d5cd-4926-b7ab-26311e66e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8340fbf2-2e04-4d4e-8a75-e75370ba5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:10:21 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Volume volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 (22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3): created successfully
Nov 05 12:10:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8340fbf2-2e04-4d4e-8a75-e75370ba5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:10:21 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Flow 'volume_create_manager' (d5f4f11e-6a03-43bb-a479-bf612648670d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:10:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b80e329c-5350-487a-8e54-1f90e292b9f9 tempest-TestStampPattern-951336140 None] Created volume successfully.
Nov 05 12:10:31 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:31 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Acquiring lock "cinder-bc76417e-4423-409e-885a-ff7ffb9f1802-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Lock "cinder-bc76417e-4423-409e-885a-ff7ffb9f1802-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Acquiring lock "cinder-quobyte-bc76417e-4423-409e-885a-ff7ffb9f1802" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Lock "cinder-quobyte-bc76417e-4423-409e-885a-ff7ffb9f1802" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8dea5-78ed-46a1-b319-3b03d4be2b04]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:32 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802
Nov 05 12:10:32 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:32 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:32 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802
Nov 05 12:10:32 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:32 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-bc76417e-4423-409e-885a-ff7ffb9f1802" returned: 0 in 0.263s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Lock "cinder-quobyte-bc76417e-4423-409e-885a-ff7ffb9f1802" released by "delete_volume" :: held 0.680s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Created reservations ['6b44ab36-6ddd-4bd0-b905-82919d2d332c', '9f4a54a0-2c38-4cdc-8170-7f06e27b65b7', 'a94902e2-bf6c-48c6-8f76-16093310d166', '0dad467d-96f3-41f7-8526-f5a447165c4e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:33 devstack sudo[102461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:10:33 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:33 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.286s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:10:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Deleted volume successfully.
Nov 05 12:10:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5035a97f-3274-4bac-9609-ced7149a44b6 tempest-VolumesNegativeTest-1552271448 None] Lock "cinder-bc76417e-4423-409e-885a-ff7ffb9f1802-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:10:43 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:43 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:10:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-7c1a5081-0787-4d3f-9398-a03a53c2cd11 req-f0886c64-38f6-40d2-918d-dc4bd1a7e7ef tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-7c1a5081-0787-4d3f-9398-a03a53c2cd11 req-f0886c64-38f6-40d2-918d-dc4bd1a7e7ef tempest-TestStampPattern-951336140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-7c1a5081-0787-4d3f-9398-a03a53c2cd11 req-f0886c64-38f6-40d2-918d-dc4bd1a7e7ef tempest-TestStampPattern-951336140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:10:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-7c1a5081-0787-4d3f-9398-a03a53c2cd11 req-f0886c64-38f6-40d2-918d-dc4bd1a7e7ef tempest-TestStampPattern-951336140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71ad59b7-aef8-44bf-87ea-f15475567cdf', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:10:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-7c1a5081-0787-4d3f-9398-a03a53c2cd11 req-f0886c64-38f6-40d2-918d-dc4bd1a7e7ef tempest-TestStampPattern-951336140 None] attachment_update completed successfully.
Nov 05 12:10:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-2791bbac-5464-4d39-aa74-54e62a3a7a48 req-5d72a06e-653e-4cc2-aa5f-bcc57815b08a tempest-TestStampPattern-951336140 None] Terminate volume connection completed successfully.
Nov 05 12:10:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2791bbac-5464-4d39-aa74-54e62a3a7a48 req-5d72a06e-653e-4cc2-aa5f-bcc57815b08a tempest-TestStampPattern-951336140 None] Deleting attachment 71ad59b7-aef8-44bf-87ea-f15475567cdf. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:10:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:10:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:10:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Creating offline snapshot 9c319445-2ee6-4c17-a922-04ee4093c642 of volume 22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:10:59 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[839119ad-d143-4992-be20-328ff57d03a9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:10:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:59 devstack sudo[102981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3
Nov 05 12:10:59 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:10:59 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root
Nov 05 12:10:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" returned: 0 in 0.432s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:10:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:10:59 devstack sudo[102986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 1G
Nov 05 12:10:59 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:00 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 1G" returned: 0 in 0.486s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:00 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642
Nov 05 12:11:00 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:00 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642" returned: 0 in 0.319s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:00 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 is being set with open permissions: ugo+rw
Nov 05 12:11:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:00 devstack sudo[102997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642
Nov 05 12:11:00 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:00 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642" returned: 0 in 0.296s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:00 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.info
Nov 05 12:11:00 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:01 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.info" returned: 0 in 0.307s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:01 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.info is being set with open permissions: ugo+rw
Nov 05 12:11:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:01 devstack sudo[103003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.info
Nov 05 12:11:01 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:01 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.info" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e8e887c9-55d4-4c99-b85b-dce393d1af71 tempest-TestStampPattern-951336140 None] Create snapshot completed successfully
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Flow 'volume_create_manager' (26d67c50-084c-4157-9c41-c400ebde4bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46f5490-0013-4767-94e0-3259dd1c37eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46f5490-0013-4767-94e0-3259dd1c37eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-140269349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ae1849-cfc9-4a65-a004-97358d90ad8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04af0ab9760742ac9c580784a0a58ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c319445-2ee6-4c17-a922-04ee4093c642,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:11Z,use_quota=True,user_id='a9d4054f28d84dd99f178a03e378bbfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9289ce-88ca-43cf-8457-6f113a09dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9289ce-88ca-43cf-8457-6f113a09dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b51740-10ce-4061-80fe-87d33f8063d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b51740-10ce-4061-80fe-87d33f8063d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14ae1849-cfc9-4a65-a004-97358d90ad8f', 'volume_name': 'volume-14ae1849-cfc9-4a65-a004-97358d90ad8f', 'volume_size': 1, 'snapshot_id': '9c319445-2ee6-4c17-a922-04ee4093c642'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf02f50-f2bc-4583-ba50-eef9eacbdd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf02f50-f2bc-4583-ba50-eef9eacbdd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d593ab-8361-4b03-9dbc-9fb510ae4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:10 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Volume 14ae1849-cfc9-4a65-a004-97358d90ad8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14ae1849-cfc9-4a65-a004-97358d90ad8f', 'volume_size': 1, 'snapshot_id': '9c319445-2ee6-4c17-a922-04ee4093c642'}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-quobyte-9c319445-2ee6-4c17-a922-04ee4093c642-14ae1849-cfc9-4a65-a004-97358d90ad8f" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-9c319445-2ee6-4c17-a922-04ee4093c642-14ae1849-cfc9-4a65-a004-97358d90ad8f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Creating volume 14ae1849-cfc9-4a65-a004-97358d90ad8f from snapshot 9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-quobyte-14ae1849-cfc9-4a65-a004-97358d90ad8f" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-14ae1849-cfc9-4a65-a004-97358d90ad8f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] snapshot: 9c319445-2ee6-4c17-a922-04ee4093c642, volume: 14ae1849-cfc9-4a65-a004-97358d90ad8f,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[604508ca-4a66-483d-8315-daf2c999a2f1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:11 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642
Nov 05 12:11:11 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:11 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642" returned: 0 in 0.642s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca144c95-daaf-493b-98c3-5ae49bf8c74a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Flow 'volume_create_manager' (620ce79d-7c18-46c4-8d35-ab04eebd9b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3533555d-a008-4de3-b00e-23177e166573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3533555d-a008-4de3-b00e-23177e166573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-255375708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f03effc-07f1-412c-9971-60473c62d68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b29e208ad014dc5821dcdf6be75e057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:12Z,use_quota=True,user_id='91774e9f8de34c69956b6ec296c963f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa811aa-eeee-4c30-93da-8f1a52ab2590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa811aa-eeee-4c30-93da-8f1a52ab2590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d41421d-6133-44c9-a54c-73e2c4a1be47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d41421d-6133-44c9-a54c-73e2c4a1be47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f03effc-07f1-412c-9971-60473c62d68c', 'volume_name': 'volume-1f03effc-07f1-412c-9971-60473c62d68c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e403f4cc-171a-4f7e-95e6-21b7aa1c6d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e403f4cc-171a-4f7e-95e6-21b7aa1c6d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec7e949-a334-485a-93fb-9880aa2937ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:11 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Volume 1f03effc-07f1-412c-9971-60473c62d68c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f03effc-07f1-412c-9971-60473c62d68c', 'volume_size': 1}
Nov 05 12:11:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:11 devstack sudo[103179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3
Nov 05 12:11:11 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:12 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" returned: 0 in 0.547s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:11:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:11:12 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:11:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:12 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f
Nov 05 12:11:12 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:11:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:13 devstack sudo[103202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:11:13 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:14 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.757s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:11:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:11:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:11:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:11:20 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:11:21 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:11:22 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f" returned: 0 in 10.432s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:22 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3, size 1024.00 MB, duration 10.43 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:11:22 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Converted 1024.00 MB image at 98.15 MB/s
Nov 05 12:11:22 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f is being set with open permissions: ugo+rw
Nov 05 12:11:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:22 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f
Nov 05 12:11:22 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:22 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f" returned: 0 in 0.261s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-14ae1849-cfc9-4a65-a004-97358d90ad8f" released by "_copy_volume_from_snapshot" :: held 12.067s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-9c319445-2ee6-4c17-a922-04ee4093c642-14ae1849-cfc9-4a65-a004-97358d90ad8f" released by "_create_volume_from_snapshot" :: held 12.152s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:11:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.177s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.167s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-255375708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f03effc-07f1-412c-9971-60473c62d68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b29e208ad014dc5821dcdf6be75e057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:11:12Z,use_quota=True,user_id='91774e9f8de34c69956b6ec296c963f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Creating volume 1f03effc-07f1-412c-9971-60473c62d68c {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:11:23 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d593ab-8361-4b03-9dbc-9fb510ae4f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ae1849-cfc9-4a65-a004-97358d90ad8f', 'volume_size': 1, 'snapshot_id': '9c319445-2ee6-4c17-a922-04ee4093c642'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcd4b34-58ac-4578-a885-e7b3a54dd492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:23 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Volume volume-14ae1849-cfc9-4a65-a004-97358d90ad8f (14ae1849-cfc9-4a65-a004-97358d90ad8f): created successfully
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcd4b34-58ac-4578-a885-e7b3a54dd492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:23 devstack sudo[103255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c 1073741824
Nov 05 12:11:23 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Flow 'volume_create_manager' (26d67c50-084c-4157-9c41-c400ebde4bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8871c9f9-6ca5-4e67-91d2-cde62aa0f7d6 tempest-TestStampPattern-951336140 None] Created volume successfully.
Nov 05 12:11:23 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c 1073741824" returned: 0 in 0.834s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:11:23 devstack sudo[103305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c
Nov 05 12:11:23 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:11:24 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root
Nov 05 12:11:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c" returned: 0 in 0.376s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:11:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:11:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec7e949-a334-485a-93fb-9880aa2937ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f03effc-07f1-412c-9971-60473c62d68c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fc6ee2-b5bb-4a89-af63-a6dcf6f9fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:11:24 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Volume volume-1f03effc-07f1-412c-9971-60473c62d68c (1f03effc-07f1-412c-9971-60473c62d68c): created successfully
Nov 05 12:11:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fc6ee2-b5bb-4a89-af63-a6dcf6f9fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:11:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Flow 'volume_create_manager' (620ce79d-7c18-46c4-8d35-ab04eebd9b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:11:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-487c317b-46a3-4989-a33e-2b024f60f71c tempest-TestMinimumBasicScenario-2146871853 None] Created volume successfully.
Nov 05 12:11:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f4744fe6-3cf5-4919-8561-74de99b09f3d req-5d243a79-0514-469e-bfa7-379e2624f897 tempest-TestMinimumBasicScenario-2146871853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:11:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f4744fe6-3cf5-4919-8561-74de99b09f3d req-5d243a79-0514-469e-bfa7-379e2624f897 tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:11:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-f4744fe6-3cf5-4919-8561-74de99b09f3d req-5d243a79-0514-469e-bfa7-379e2624f897 tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:11:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-f4744fe6-3cf5-4919-8561-74de99b09f3d req-5d243a79-0514-469e-bfa7-379e2624f897 tempest-TestMinimumBasicScenario-2146871853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-1f03effc-07f1-412c-9971-60473c62d68c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '343ee486-6859-467d-989d-5eda2124a37e', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:11:26 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-f4744fe6-3cf5-4919-8561-74de99b09f3d req-5d243a79-0514-469e-bfa7-379e2624f897 tempest-TestMinimumBasicScenario-2146871853 None] attachment_update completed successfully.
Nov 05 12:11:36 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:11:36 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:11:56 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:11:56 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:12:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-fbb6938e-e6f8-4998-be71-438c46ea510d req-c09f5ee7-0176-4290-a3a4-0cccadbdae32 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-fbb6938e-e6f8-4998-be71-438c46ea510d req-c09f5ee7-0176-4290-a3a4-0cccadbdae32 tempest-TestStampPattern-951336140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-fbb6938e-e6f8-4998-be71-438c46ea510d req-c09f5ee7-0176-4290-a3a4-0cccadbdae32 tempest-TestStampPattern-951336140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-fbb6938e-e6f8-4998-be71-438c46ea510d req-c09f5ee7-0176-4290-a3a4-0cccadbdae32 tempest-TestStampPattern-951336140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-14ae1849-cfc9-4a65-a004-97358d90ad8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30c7d445-821b-4ef4-bd99-c9595b1e3902', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:12:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-fbb6938e-e6f8-4998-be71-438c46ea510d req-c09f5ee7-0176-4290-a3a4-0cccadbdae32 tempest-TestStampPattern-951336140 None] attachment_update completed successfully.
Nov 05 12:12:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-38d156a7-aef5-4ae1-a38b-8145d2db5964 req-e067ec15-9516-4b00-a3f4-0d141d708c57 tempest-TestStampPattern-951336140 None] Terminate volume connection completed successfully.
Nov 05 12:12:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-38d156a7-aef5-4ae1-a38b-8145d2db5964 req-e067ec15-9516-4b00-a3f4-0d141d708c57 tempest-TestStampPattern-951336140 None] Deleting attachment 30c7d445-821b-4ef4-bd99-c9595b1e3902. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:12:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-bdc733cc-21a2-42b7-8983-6311c796429f req-8da66dba-c2c6-455e-9132-7b85e5404785 tempest-TestMinimumBasicScenario-2146871853 None] Terminate volume connection completed successfully.
Nov 05 12:12:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-bdc733cc-21a2-42b7-8983-6311c796429f req-8da66dba-c2c6-455e-9132-7b85e5404785 tempest-TestMinimumBasicScenario-2146871853 None] Deleting attachment 343ee486-6859-467d-989d-5eda2124a37e. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:12:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Acquiring lock "cinder-1f03effc-07f1-412c-9971-60473c62d68c-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Lock "cinder-1f03effc-07f1-412c-9971-60473c62d68c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Acquiring lock "cinder-quobyte-1f03effc-07f1-412c-9971-60473c62d68c" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Lock "cinder-quobyte-1f03effc-07f1-412c-9971-60473c62d68c" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e137bf-2ccd-4226-a005-72a3372654bf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:12 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c
Nov 05 12:12:12 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:12 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c" returned: 0 in 0.397s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:12 devstack sudo[103966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c
Nov 05 12:12:12 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-14ae1849-cfc9-4a65-a004-97358d90ad8f-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Lock "cinder-14ae1849-cfc9-4a65-a004-97358d90ad8f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-quobyte-14ae1849-cfc9-4a65-a004-97358d90ad8f" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-14ae1849-cfc9-4a65-a004-97358d90ad8f" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:12 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1f03effc-07f1-412c-9971-60473c62d68c" returned: 0 in 0.324s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Lock "cinder-quobyte-1f03effc-07f1-412c-9971-60473c62d68c" released by "delete_volume" :: held 0.793s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d499a430-7c7b-412d-a16f-01e3293cca91]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:12 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Created reservations ['09974651-1d56-4372-adb9-633e9b371017', '523b9e59-129c-496c-832f-1fb0c68b539c', 'ca6cf57d-88fc-4091-b8a2-f7afa5f61993', '5fd6310e-0bd8-4067-897d-4b618df81fa6'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:13 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f
Nov 05 12:12:13 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:13 devstack sudo[103971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:13 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:13 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:13 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Deleted volume successfully.
Nov 05 12:12:13 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f" returned: 0 in 0.494s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-fd8ff3cf-ab62-42cf-85ec-00aea37378c3 tempest-TestMinimumBasicScenario-2146871853 None] Lock "cinder-1f03effc-07f1-412c-9971-60473c62d68c-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:13 devstack sudo[103977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f
Nov 05 12:12:13 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:13 devstack sudo[103988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:13 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:13 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-14ae1849-cfc9-4a65-a004-97358d90ad8f" returned: 0 in 0.436s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-14ae1849-cfc9-4a65-a004-97358d90ad8f" released by "delete_volume" :: held 1.004s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:13 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Created reservations ['92831463-07ec-47db-9bdd-5876fb2417f0', '57646347-8eeb-4171-a0d5-90b01e15c7cf', '91cf06be-58a4-462c-bdda-77d0257aa5f2', '8bb2a54e-a41a-45be-873e-f4a660a2f318'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:14 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.412s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:14 devstack sudo[104002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:14 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:14 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.285s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:14 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Deleted volume successfully.
Nov 05 12:12:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e548345b-5308-4069-93bd-e3761d54c1ee tempest-TestStampPattern-951336140 None] Lock "cinder-14ae1849-cfc9-4a65-a004-97358d90ad8f-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-9c319445-2ee6-4c17-a922-04ee4093c642-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Lock "cinder-9c319445-2ee6-4c17-a922-04ee4093c642-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-quobyte-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-quobyte-9c319445-2ee6-4c17-a922-04ee4093c642" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-9c319445-2ee6-4c17-a922-04ee4093c642" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Deleting offline snapshot 9c319445-2ee6-4c17-a922-04ee4093c642 of volume 22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] snapshot_file for this snap is: volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3394b72-1b3e-4383-9716-67b4846735d2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:15 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642
Nov 05 12:12:15 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:15 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642" returned: 0 in 0.400s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b696bb-8403-4a78-b90e-cfb39dd2a300]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:16 devstack sudo[104013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3
Nov 05 12:12:16 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:16 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" returned: 0 in 0.599s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:16 devstack sudo[104018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642
Nov 05 12:12:16 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:16 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642" returned: 0 in 0.371s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:16 devstack sudo[104024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642
Nov 05 12:12:16 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:17 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3.9c319445-2ee6-4c17-a922-04ee4093c642" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-9c319445-2ee6-4c17-a922-04ee4093c642" released by "_delete_snapshot" :: held 1.776s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" released by "delete_snapshot" :: held 1.802s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:17 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Created reservations ['b90b12de-e118-4a44-b6ee-0391a928e6ab', 'a7a53f0e-0431-41af-bbd8-c14d7e5e5f5b', '9f24bec5-973e-4fcf-b21b-f5e3163a46ea', 'ea7b3a84-8804-4cc2-8fac-f5ebbd39c04e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Delete snapshot completed successfully.
Nov 05 12:12:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7337578b-9707-4835-a9d3-6f433251d5f8 tempest-TestStampPattern-951336140 None] Lock "cinder-9c319445-2ee6-4c17-a922-04ee4093c642-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Lock "cinder-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Acquiring lock "cinder-quobyte-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce439c-d181-431d-b10f-468e7972ffaf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:22 devstack sudo[104057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3
Nov 05 12:12:22 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:22 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" returned: 0 in 0.483s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:22 devstack sudo[104063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3
Nov 05 12:12:22 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:22 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" returned: 0 in 0.246s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Lock "cinder-quobyte-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3" released by "delete_volume" :: held 0.806s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Created reservations ['c74f46c7-b864-4366-9d9d-b4ff40c334c9', '7c0f2cad-7fc1-4b1f-b72f-ac1cb5285412', 'b94ccf8d-47cd-4406-bf66-4b7dec07105a', '5c8e6f04-f474-45e7-86e0-bcee776e2317'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:22 devstack sudo[104066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:22 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:23 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.309s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:23 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Deleted volume successfully.
Nov 05 12:12:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86503912-e1cd-4a9b-8dca-e714204c7cd5 tempest-TestStampPattern-951336140 None] Lock "cinder-22aea91f-9e6c-40fb-b4f2-0a4f89c8dcb3-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:32 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=32,cinder:UPDATE=31,cinder:INSERT=10 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:12:33 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=26,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (e4c06945-d8cb-40e4-b7d7-eda822c3e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55980cc5-6363-4d11-9311-0c26803dd79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55980cc5-6363-4d11-9311-0c26803dd79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1886359682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e00655e-ab68-4a7b-9641-3480f90095d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:37Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cfdf9b-d39f-489e-9a69-94503e82f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cfdf9b-d39f-489e-9a69-94503e82f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c586559-df9d-48e6-bafd-13b542d45f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c586559-df9d-48e6-bafd-13b542d45f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e00655e-ab68-4a7b-9641-3480f90095d8', 'volume_name': 'volume-4e00655e-ab68-4a7b-9641-3480f90095d8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29768b8-d9b4-4e32-9441-bd2e3b59fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29768b8-d9b4-4e32-9441-bd2e3b59fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122b2409-5658-40bc-95ad-27a0ffbe9183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:36 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume 4e00655e-ab68-4a7b-9641-3480f90095d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e00655e-ab68-4a7b-9641-3480f90095d8', 'volume_size': 1}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1886359682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e00655e-ab68-4a7b-9641-3480f90095d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:37Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Creating volume 4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:36 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:12:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:36 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 1073741824
Nov 05 12:12:36 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:37 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 1073741824" returned: 0 in 0.563s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:37 devstack sudo[104085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8
Nov 05 12:12:37 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:37 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8" returned: 0 in 0.286s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122b2409-5658-40bc-95ad-27a0ffbe9183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e00655e-ab68-4a7b-9641-3480f90095d8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d926eefc-9977-43d6-b4f0-5cfa0bc117c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume volume-4e00655e-ab68-4a7b-9641-3480f90095d8 (4e00655e-ab68-4a7b-9641-3480f90095d8): created successfully
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d926eefc-9977-43d6-b4f0-5cfa0bc117c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (e4c06945-d8cb-40e4-b7d7-eda822c3e83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3cd8b177-a7c3-45c2-99ad-4c8152826a82 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created volume successfully.
Nov 05 12:12:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Creating offline snapshot 43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb of volume 4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:12:39 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c5172-c847-470e-8c36-4e8509816ada]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:39 devstack sudo[104089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8
Nov 05 12:12:39 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:39 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8" returned: 0 in 0.482s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:39 devstack sudo[104094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb 1G
Nov 05 12:12:39 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:40 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb 1G" returned: 0 in 0.542s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e00655e-ab68-4a7b-9641-3480f90095d8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:40 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e00655e-ab68-4a7b-9641-3480f90095d8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb
Nov 05 12:12:40 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:40 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e00655e-ab68-4a7b-9641-3480f90095d8 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" returned: 0 in 0.353s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:40 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb is being set with open permissions: ugo+rw
Nov 05 12:12:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:40 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb
Nov 05 12:12:40 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:40 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" returned: 0 in 0.261s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:40 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.info
Nov 05 12:12:40 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:41 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.info" returned: 0 in 0.256s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:41 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.info is being set with open permissions: ugo+rw
Nov 05 12:12:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:41 devstack sudo[104110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.info
Nov 05 12:12:41 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:41 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.info" returned: 0 in 0.263s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5f4791a8-d2ea-484f-b9cb-baa38efa3677 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Create snapshot completed successfully
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (492ce67a-69df-4fa2-8cfc-d45bb4344c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f799b5f-c1e2-45ce-a866-7387de802b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f799b5f-c1e2-45ce-a866-7387de802b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713255960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87dfe47e-b265-4d1c-a5cf-c749c4dfbe84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:43Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc76e4d0-6e67-42a7-b2c3-e9c9845ac598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc76e4d0-6e67-42a7-b2c3-e9c9845ac598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54fa365-4caf-4bfd-a19e-f2d194e601fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54fa365-4caf-4bfd-a19e-f2d194e601fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87dfe47e-b265-4d1c-a5cf-c749c4dfbe84', 'volume_name': 'volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72aa215-a34b-43d2-94e3-3da64fb9fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72aa215-a34b-43d2-94e3-3da64fb9fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2108177a-77e2-4631-924a-4fc6e13e0223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume 87dfe47e-b265-4d1c-a5cf-c749c4dfbe84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84', 'volume_size': 1}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713255960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87dfe47e-b265-4d1c-a5cf-c749c4dfbe84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:43Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Creating volume 87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:42 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:12:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:43 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 1073741824
Nov 05 12:12:43 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (f98a4e7d-e10e-4d8d-b4cb-e40d08d7e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f35e716-953d-4df6-825b-a75cb44f1735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f35e716-953d-4df6-825b-a75cb44f1735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609421201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8c51a-4450-415d-9837-0dbad26cd48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:43Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a487ca-18b4-4406-8e90-c0dd17240d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a487ca-18b4-4406-8e90-c0dd17240d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77e9491-6a08-40b4-ac7b-affb2c9b5d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77e9491-6a08-40b4-ac7b-affb2c9b5d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d8c51a-4450-415d-9837-0dbad26cd48c', 'volume_name': 'volume-d9d8c51a-4450-415d-9837-0dbad26cd48c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d540aa71-d208-445a-89f3-d9076e0beaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d540aa71-d208-445a-89f3-d9076e0beaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb3f4df-ab75-4fbd-9faa-425d0a0f77f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:43 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume d9d8c51a-4450-415d-9837-0dbad26cd48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d8c51a-4450-415d-9837-0dbad26cd48c', 'volume_size': 1}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:43 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 1073741824" returned: 0 in 0.629s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:43 devstack sudo[104119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84
Nov 05 12:12:43 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (4b8ef98a-1adf-4bf6-a146-d61ead0452dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a596375-3bae-4fd5-85e9-284ca3bc4991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a596375-3bae-4fd5-85e9-284ca3bc4991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1939508885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d80922e-e4c7-45c2-83e4-0613417373b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:44Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5da6a2-4e22-4140-af68-a2ef3e263513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5da6a2-4e22-4140-af68-a2ef3e263513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0776d3f1-72ef-4a8a-b100-dd8ab7cf17f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0776d3f1-72ef-4a8a-b100-dd8ab7cf17f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d80922e-e4c7-45c2-83e4-0613417373b8', 'volume_name': 'volume-1d80922e-e4c7-45c2-83e4-0613417373b8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b6767a-d951-4bda-9767-f44308e60692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b6767a-d951-4bda-9767-f44308e60692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eecc3b-3d51-48af-9f67-9060f2c322b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume 1d80922e-e4c7-45c2-83e4-0613417373b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d80922e-e4c7-45c2-83e4-0613417373b8', 'volume_size': 1}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84" returned: 0 in 0.529s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609421201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8c51a-4450-415d-9837-0dbad26cd48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:43Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Creating volume d9d8c51a-4450-415d-9837-0dbad26cd48c {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:44 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2108177a-77e2-4631-924a-4fc6e13e0223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e89586c-57dd-4e7c-b975-90f75d9fa092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 (87dfe47e-b265-4d1c-a5cf-c749c4dfbe84): created successfully
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e89586c-57dd-4e7c-b975-90f75d9fa092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (492ce67a-69df-4fa2-8cfc-d45bb4344c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:44 devstack sudo[104123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c 1073741824
Nov 05 12:12:44 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-398e822f-cd4f-46aa-b8e2-524a1c5c854e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created volume successfully.
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (65d455c1-37be-414f-b008-fe2136820516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84711aee-415f-47c2-bfba-b96fefbf6ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84711aee-415f-47c2-bfba-b96fefbf6ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406667752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a449ec-c124-4392-be98-5ba2defce348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:44Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560a357e-2900-4368-9e2e-6e0f6b6149b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560a357e-2900-4368-9e2e-6e0f6b6149b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a027a11-1103-4b7f-9aec-82862e8b0a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a027a11-1103-4b7f-9aec-82862e8b0a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a449ec-c124-4392-be98-5ba2defce348', 'volume_name': 'volume-36a449ec-c124-4392-be98-5ba2defce348', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db68deb-366f-40d9-be82-d829f37094df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db68deb-366f-40d9-be82-d829f37094df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d304eb-1391-4232-8ae5-59a48521fd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume 36a449ec-c124-4392-be98-5ba2defce348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a449ec-c124-4392-be98-5ba2defce348', 'volume_size': 1}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (48699b89-253a-4ce6-a931-f87ca4f53a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6009022-cbdd-4a79-a69a-348b4b6d7d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6009022-cbdd-4a79-a69a-348b4b6d7d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1432238345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4c1b00-162a-4ac7-b071-44c9c31f583d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:45Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8933d8f-7934-41d4-9983-b6314d330896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8933d8f-7934-41d4-9983-b6314d330896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e98fe0-deb6-4ea9-825b-8cd014756dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e98fe0-deb6-4ea9-825b-8cd014756dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b4c1b00-162a-4ac7-b071-44c9c31f583d', 'volume_name': 'volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4220d797-5bb9-45a4-a7d7-7fddd2e59901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4220d797-5bb9-45a4-a7d7-7fddd2e59901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a27d7ed-0f4a-439a-9f71-6e49a690edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:44 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume 6b4c1b00-162a-4ac7-b071-44c9c31f583d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d', 'volume_size': 1}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:44 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c 1073741824" returned: 0 in 0.592s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:44 devstack sudo[104129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c
Nov 05 12:12:44 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:45 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c" returned: 0 in 0.259s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1939508885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d80922e-e4c7-45c2-83e4-0613417373b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:44Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Creating volume 1d80922e-e4c7-45c2-83e4-0613417373b8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:45 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb3f4df-ab75-4fbd-9faa-425d0a0f77f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d8c51a-4450-415d-9837-0dbad26cd48c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:45 devstack sudo[104132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8 1073741824
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1773db48-21f6-4313-9df4-b70c8b175ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:45 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:45 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume volume-d9d8c51a-4450-415d-9837-0dbad26cd48c (d9d8c51a-4450-415d-9837-0dbad26cd48c): created successfully
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1773db48-21f6-4313-9df4-b70c8b175ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (f98a4e7d-e10e-4d8d-b4cb-e40d08d7e57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-278ae247-33cd-4a17-ba84-5bfe610d7727 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created volume successfully.
Nov 05 12:12:45 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8 1073741824" returned: 0 in 0.507s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:45 devstack sudo[104138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8
Nov 05 12:12:45 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:45 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8" returned: 0 in 0.287s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406667752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a449ec-c124-4392-be98-5ba2defce348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:44Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Creating volume 36a449ec-c124-4392-be98-5ba2defce348 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:45 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eecc3b-3d51-48af-9f67-9060f2c322b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d80922e-e4c7-45c2-83e4-0613417373b8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:45 devstack sudo[104141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348 1073741824
Nov 05 12:12:45 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb87937-5c42-42b6-b36a-b912103a4436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:45 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume volume-1d80922e-e4c7-45c2-83e4-0613417373b8 (1d80922e-e4c7-45c2-83e4-0613417373b8): created successfully
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb87937-5c42-42b6-b36a-b912103a4436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (4b8ef98a-1adf-4bf6-a146-d61ead0452dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-815ff9d6-9f9e-4dee-9ff5-594cb0196300 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created volume successfully.
Nov 05 12:12:46 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348 1073741824" returned: 0 in 0.484s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:46 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348
Nov 05 12:12:46 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:46 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348" returned: 0 in 0.402s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1432238345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4c1b00-162a-4ac7-b071-44c9c31f583d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c18e015cf749038564257f39346622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:12:45Z,use_quota=True,user_id='20e46ae7f5ca4b6a9f92e24cecaa6dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Creating volume 6b4c1b00-162a-4ac7-b071-44c9c31f583d {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:12:46 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:46 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d 1073741824
Nov 05 12:12:46 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d304eb-1391-4232-8ae5-59a48521fd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a449ec-c124-4392-be98-5ba2defce348', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e081d010-5d66-443c-b8d5-6f523ac9a292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:46 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume volume-36a449ec-c124-4392-be98-5ba2defce348 (36a449ec-c124-4392-be98-5ba2defce348): created successfully
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e081d010-5d66-443c-b8d5-6f523ac9a292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (65d455c1-37be-414f-b008-fe2136820516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3a1cd604-2ec4-4cd7-937c-d4a8b20e55e4 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created volume successfully.
Nov 05 12:12:47 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d 1073741824" returned: 0 in 0.512s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:47 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d
Nov 05 12:12:47 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:47 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d" returned: 0 in 0.371s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a27d7ed-0f4a-439a-9f71-6e49a690edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4acc3e-4381-42c7-ba70-98fd7b0c4953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:12:47 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Volume volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d (6b4c1b00-162a-4ac7-b071-44c9c31f583d): created successfully
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4acc3e-4381-42c7-ba70-98fd7b0c4953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:12:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Flow 'volume_create_manager' (48699b89-253a-4ce6-a931-f87ca4f53a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:12:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f2d6fd07-7bcd-4b05-8552-d410e628d2cd tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created volume successfully.
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-6b4c1b00-162a-4ac7-b071-44c9c31f583d-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-6b4c1b00-162a-4ac7-b071-44c9c31f583d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-6b4c1b00-162a-4ac7-b071-44c9c31f583d" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-6b4c1b00-162a-4ac7-b071-44c9c31f583d" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[389f8ee1-ae75-45f5-ab04-e5bd05056e50]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:48 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d
Nov 05 12:12:48 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:48 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d" returned: 0 in 0.509s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:48 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d
Nov 05 12:12:48 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:49 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b4c1b00-162a-4ac7-b071-44c9c31f583d" returned: 0 in 0.340s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-6b4c1b00-162a-4ac7-b071-44c9c31f583d" released by "delete_volume" :: held 0.911s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created reservations ['48c20ef3-a703-4a23-a642-e9601d889bd3', '978f35a9-eaf6-490e-899e-3b397b705368', '0c08dd9c-5a50-49bb-8966-140998753b1e', 'f65cc5ae-e037-4c58-b458-4011bcf27b93'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:49 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:49 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:49 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.307s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Deleted volume successfully.
Nov 05 12:12:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6799bc29-90bd-4acc-b24d-4d4a2b059e9e tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-6b4c1b00-162a-4ac7-b071-44c9c31f583d-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-36a449ec-c124-4392-be98-5ba2defce348-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-36a449ec-c124-4392-be98-5ba2defce348-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-36a449ec-c124-4392-be98-5ba2defce348" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-36a449ec-c124-4392-be98-5ba2defce348" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bef1567-066b-4a49-bc23-c6726ee71c5d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:50 devstack sudo[104169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348
Nov 05 12:12:50 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:51 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348" returned: 0 in 0.460s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:51 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348
Nov 05 12:12:51 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:51 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-36a449ec-c124-4392-be98-5ba2defce348" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-36a449ec-c124-4392-be98-5ba2defce348" released by "delete_volume" :: held 0.775s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created reservations ['7a7abdec-31db-42f0-83c8-4a1aabaadd30', 'a086fab1-f8a8-4189-92ea-4feb8e76a284', 'd202041a-c3c2-4ded-bb8c-671502fd4ce0', '60e08552-f5a1-45d0-ba40-9d5aede4c7a7'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:51 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:51 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-1d80922e-e4c7-45c2-83e4-0613417373b8-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-1d80922e-e4c7-45c2-83e4-0613417373b8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:51 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.338s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-1d80922e-e4c7-45c2-83e4-0613417373b8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Deleted volume successfully.
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-1d80922e-e4c7-45c2-83e4-0613417373b8" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3a0107ac-af57-4c24-948e-76b9c8aba7da tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-36a449ec-c124-4392-be98-5ba2defce348-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd73900-182e-44bb-a452-cddb2d70844c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:52 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8
Nov 05 12:12:52 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:52 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8" returned: 0 in 0.387s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:52 devstack sudo[104185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8
Nov 05 12:12:52 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:52 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1d80922e-e4c7-45c2-83e4-0613417373b8" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-1d80922e-e4c7-45c2-83e4-0613417373b8" released by "delete_volume" :: held 0.766s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created reservations ['d4662f2e-d9f0-4e38-a205-6b8e37e1b537', '916819bc-fc8d-412f-8c60-ec8373e312dc', 'c5c84552-df32-4b4f-9d06-d339347f02b4', 'bf89e70d-52a0-44aa-87aa-571d1abfc552'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:52 devstack sudo[104188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:52 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-d9d8c51a-4450-415d-9837-0dbad26cd48c-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-d9d8c51a-4450-415d-9837-0dbad26cd48c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-d9d8c51a-4450-415d-9837-0dbad26cd48c" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-d9d8c51a-4450-415d-9837-0dbad26cd48c" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2633796-a49b-4c5d-8d95-cf05a62de7c3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:53 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.319s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Deleted volume successfully.
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b956fb98-e5ca-421e-aec9-a1af4677aa2a tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-1d80922e-e4c7-45c2-83e4-0613417373b8-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:53 devstack sudo[104191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c
Nov 05 12:12:53 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:53 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c" returned: 0 in 0.439s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:53 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c
Nov 05 12:12:53 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:53 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9d8c51a-4450-415d-9837-0dbad26cd48c" returned: 0 in 0.326s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-d9d8c51a-4450-415d-9837-0dbad26cd48c" released by "delete_volume" :: held 0.829s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created reservations ['bac257bb-eb34-4385-9385-2176b7fa65ad', '2f3f25fd-5cd6-45be-b66d-f597fe6ff30b', '0b216765-7eac-42c7-96ab-ac6a773a37bf', '3fb92f33-3109-4db5-8a7f-11d46c226abf'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:54 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:54 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3050f5ef-5048-4761-9278-360cfc7ed422]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:54 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.366s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Deleted volume successfully.
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b0ab430d-d1dd-4b86-bbbf-bddf5cfb98a5 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-d9d8c51a-4450-415d-9837-0dbad26cd48c-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:54 devstack sudo[104203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84
Nov 05 12:12:54 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:54 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84" returned: 0 in 0.442s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:54 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84
Nov 05 12:12:54 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:54 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84" returned: 0 in 0.259s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84" released by "delete_volume" :: held 0.766s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created reservations ['40a6f959-a0e5-4d5f-a53d-e831fd2f8b44', 'c6e14ad4-2c46-4c67-8413-017176930826', 'f1e2a495-6da8-4bbc-b566-bc81b14458b3', '0519258b-e662-4d4c-8c2f-af0b9fb41571'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:55 devstack sudo[104211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:55 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-4e00655e-ab68-4a7b-9641-3480f90095d8" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-4e00655e-ab68-4a7b-9641-3480f90095d8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Deleting offline snapshot 43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb of volume 4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:12:55 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] snapshot_file for this snap is: volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.310s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Deleted volume successfully.
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c159c7-3763-43b9-9489-42f419828d97]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cc2af734-ad18-494c-b429-5cb07d50a59d tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-87dfe47e-b265-4d1c-a5cf-c749c4dfbe84-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:55 devstack sudo[104214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb
Nov 05 12:12:55 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:55 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" returned: 0 in 0.418s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e00655e-ab68-4a7b-9641-3480f90095d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f8f07-942b-4882-8f26-1316b8ca37ac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:56 devstack sudo[104219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8
Nov 05 12:12:56 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:56 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8" returned: 0 in 0.437s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:56 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb
Nov 05 12:12:56 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:56 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" returned: 0 in 0.400s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:56 devstack sudo[104233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb
Nov 05 12:12:56 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:57 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8.43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" returned: 0 in 0.280s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb" released by "_delete_snapshot" :: held 1.689s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-4e00655e-ab68-4a7b-9641-3480f90095d8" released by "delete_snapshot" :: held 1.715s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created reservations ['2f003ff2-f977-4149-832d-41cbb8c3e79e', '220526ad-2f06-4554-845c-ce6c76152004', '9c868a43-92be-4d48-9f83-71ab57ff20f0', '8a153c14-8177-4a33-85e0-89ab10e5ae5f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Delete snapshot completed successfully.
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-18c6df50-62a6-4e4c-b736-f324cc81435f tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-43cd8c75-ec7d-467e-bb4f-d4d21a3dc1fb-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-4e00655e-ab68-4a7b-9641-3480f90095d8-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-4e00655e-ab68-4a7b-9641-3480f90095d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "cinder-quobyte-4e00655e-ab68-4a7b-9641-3480f90095d8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-4e00655e-ab68-4a7b-9641-3480f90095d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f6cd34-6f57-4125-aa51-cea5c433b1f5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:12:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:57 devstack sudo[104245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8
Nov 05 12:12:57 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:58 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8" returned: 0 in 0.469s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:58 devstack sudo[104261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8
Nov 05 12:12:58 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:58 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4e00655e-ab68-4a7b-9641-3480f90095d8" returned: 0 in 0.330s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-quobyte-4e00655e-ab68-4a7b-9641-3480f90095d8" released by "delete_volume" :: held 0.894s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Created reservations ['095db979-a531-43ed-b9bc-281846582537', 'e262a5c3-b1f8-44fb-8f51-ca3846c49578', '51b19928-793e-4644-8d87-396e83aab0f6', '0b414806-1657-4d9c-9eb8-e140fc1755ea'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:12:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:12:58 devstack sudo[104266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:12:58 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:12:59 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root
Nov 05 12:12:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:12:59 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:12:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Deleted volume successfully.
Nov 05 12:12:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8470100c-c979-4e58-9996-6dd1c3bc93a2 tempest-CreateVolumesFromSnapshotTest-1599919411 None] Lock "cinder-4e00655e-ab68-4a7b-9641-3480f90095d8-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Flow 'volume_create_manager' (9a874078-1dbf-4263-a59a-68cdb23b98ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dd7926-efb6-4b96-aeee-58f722a7bb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dd7926-efb6-4b96-aeee-58f722a7bb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1217092192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc95af04-9744-4771-9231-dc24e5a8b4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c819f032c3d048c9a23686ed40c7c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:03Z,use_quota=True,user_id='f90d139bce2c472ba6ba39115efadce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f408c6-0512-43a0-a2f3-cad276a10b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f408c6-0512-43a0-a2f3-cad276a10b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c724f56-45cb-4dab-b6f8-ab3d664a18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c724f56-45cb-4dab-b6f8-ab3d664a18d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc95af04-9744-4771-9231-dc24e5a8b4df', 'volume_name': 'volume-cc95af04-9744-4771-9231-dc24e5a8b4df', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59854ae-67cf-4cf2-b30d-051d6ddca4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59854ae-67cf-4cf2-b30d-051d6ddca4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800a004f-2cd9-4809-a94b-01870b7de7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Volume cc95af04-9744-4771-9231-dc24e5a8b4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc95af04-9744-4771-9231-dc24e5a8b4df', 'volume_size': 1}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1217092192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc95af04-9744-4771-9231-dc24e5a8b4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c819f032c3d048c9a23686ed40c7c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:03Z,use_quota=True,user_id='f90d139bce2c472ba6ba39115efadce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Creating volume cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:03 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:03 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df 1073741824
Nov 05 12:13:03 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:03 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df 1073741824" returned: 0 in 0.563s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:03 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df
Nov 05 12:13:03 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:04 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df" returned: 0 in 0.340s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800a004f-2cd9-4809-a94b-01870b7de7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc95af04-9744-4771-9231-dc24e5a8b4df', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94584fbe-e61e-4dbd-870a-f27cba493cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:04 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Volume volume-cc95af04-9744-4771-9231-dc24e5a8b4df (cc95af04-9744-4771-9231-dc24e5a8b4df): created successfully
Nov 05 12:13:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94584fbe-e61e-4dbd-870a-f27cba493cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Flow 'volume_create_manager' (9a874078-1dbf-4263-a59a-68cdb23b98ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-735ed97a-d53f-4b61-aa60-25007651b41c tempest-VolumeDependencyTests-717928617 None] Created volume successfully.
Nov 05 12:13:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Creating offline snapshot 3f069fb4-a785-4d30-ba86-11facd1109ac of volume cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:13:05 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b52fe2-7932-4ded-95be-63a746fe3ec1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:05 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df
Nov 05 12:13:05 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:05 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df" returned: 0 in 0.381s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:05 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac 1G
Nov 05 12:13:05 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:06 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac 1G" returned: 0 in 0.417s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc95af04-9744-4771-9231-dc24e5a8b4df -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:06 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc95af04-9744-4771-9231-dc24e5a8b4df -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac
Nov 05 12:13:06 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:06 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc95af04-9744-4771-9231-dc24e5a8b4df -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:06 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac is being set with open permissions: ugo+rw
Nov 05 12:13:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:06 devstack sudo[104371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac
Nov 05 12:13:06 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:06 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac" returned: 0 in 0.297s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:07 devstack sudo[104374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.info
Nov 05 12:13:07 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:07 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.info" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:07 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.info is being set with open permissions: ugo+rw
Nov 05 12:13:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:07 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.info
Nov 05 12:13:07 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:07 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.info" returned: 0 in 0.256s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-597e23ba-e936-46b9-af35-ebd6b0d01769 tempest-VolumeDependencyTests-717928617 None] Create snapshot completed successfully
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Flow 'volume_create_manager' (6610ec3e-8ffa-49fd-85ce-db8a2cca0435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9c56ac-f08b-43f8-bb74-ef59315c7f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9c56ac-f08b-43f8-bb74-ef59315c7f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-780801651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5cc8876-d369-4945-9204-c7b8acd38ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c819f032c3d048c9a23686ed40c7c12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3f069fb4-a785-4d30-ba86-11facd1109ac,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:09Z,use_quota=True,user_id='f90d139bce2c472ba6ba39115efadce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3760c17a-5de6-4b4f-a384-45d4f08270e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3760c17a-5de6-4b4f-a384-45d4f08270e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d115170-6040-4a2f-b139-e86028eec337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d115170-6040-4a2f-b139-e86028eec337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5cc8876-d369-4945-9204-c7b8acd38ff4', 'volume_name': 'volume-a5cc8876-d369-4945-9204-c7b8acd38ff4', 'volume_size': 1, 'snapshot_id': '3f069fb4-a785-4d30-ba86-11facd1109ac'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52318c94-497c-4c78-81f7-2f6192ed2378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52318c94-497c-4c78-81f7-2f6192ed2378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d32fc-623c-4773-821c-afabee094a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:09 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Volume a5cc8876-d369-4945-9204-c7b8acd38ff4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5cc8876-d369-4945-9204-c7b8acd38ff4', 'volume_size': 1, 'snapshot_id': '3f069fb4-a785-4d30-ba86-11facd1109ac'}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-quobyte-3f069fb4-a785-4d30-ba86-11facd1109ac-a5cc8876-d369-4945-9204-c7b8acd38ff4" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-3f069fb4-a785-4d30-ba86-11facd1109ac-a5cc8876-d369-4945-9204-c7b8acd38ff4" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Creating volume a5cc8876-d369-4945-9204-c7b8acd38ff4 from snapshot 3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-quobyte-a5cc8876-d369-4945-9204-c7b8acd38ff4" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-a5cc8876-d369-4945-9204-c7b8acd38ff4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] snapshot: 3f069fb4-a785-4d30-ba86-11facd1109ac, volume: a5cc8876-d369-4945-9204-c7b8acd38ff4,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d26a29b-4581-42a0-a8ed-f4bfb8ed0e19]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:09 devstack sudo[104380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac
Nov 05 12:13:09 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:09 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac" returned: 0 in 0.373s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc95af04-9744-4771-9231-dc24e5a8b4df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a7575-1f78-47f7-8cf5-dc617d3d1f2a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:09 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df
Nov 05 12:13:09 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:10 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df" returned: 0 in 0.371s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:13:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:13:10 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:13:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:10 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4
Nov 05 12:13:10 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:13:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:13 devstack sudo[104440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:13 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:14 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.402s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:13:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:13:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:13:17 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4" returned: 0 in 7.009s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:13:17 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Converted 1024.00 MB image at 146.05 MB/s
Nov 05 12:13:17 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 is being set with open permissions: ugo+rw
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:17 devstack sudo[104466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4
Nov 05 12:13:17 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:17 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4" returned: 0 in 0.246s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-a5cc8876-d369-4945-9204-c7b8acd38ff4" released by "_copy_volume_from_snapshot" :: held 8.083s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-3f069fb4-a785-4d30-ba86-11facd1109ac-a5cc8876-d369-4945-9204-c7b8acd38ff4" released by "_create_volume_from_snapshot" :: held 8.148s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.166s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d32fc-623c-4773-821c-afabee094a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5cc8876-d369-4945-9204-c7b8acd38ff4', 'volume_size': 1, 'snapshot_id': '3f069fb4-a785-4d30-ba86-11facd1109ac'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c53883-2b21-4b36-868b-66d3d9a5424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:17 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Volume volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 (a5cc8876-d369-4945-9204-c7b8acd38ff4): created successfully
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c53883-2b21-4b36-868b-66d3d9a5424d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Flow 'volume_create_manager' (6610ec3e-8ffa-49fd-85ce-db8a2cca0435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c6c718dd-562d-4f61-8566-b7dd41ca4f66 tempest-VolumeDependencyTests-717928617 None] Created volume successfully.
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-3f069fb4-a785-4d30-ba86-11facd1109ac-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-3f069fb4-a785-4d30-ba86-11facd1109ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-quobyte-cc95af04-9744-4771-9231-dc24e5a8b4df" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-cc95af04-9744-4771-9231-dc24e5a8b4df" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-quobyte-3f069fb4-a785-4d30-ba86-11facd1109ac" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-3f069fb4-a785-4d30-ba86-11facd1109ac" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Deleting offline snapshot 3f069fb4-a785-4d30-ba86-11facd1109ac of volume cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:13:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] snapshot_file for this snap is: volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[11426d4c-34f7-4564-8b70-26fed79f3ae2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:18 devstack sudo[104470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac
Nov 05 12:13:18 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:18 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac" returned: 0 in 0.364s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc95af04-9744-4771-9231-dc24e5a8b4df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2f2938-6eae-4d57-91b7-0c53e25d7bb5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:18 devstack sudo[104475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df
Nov 05 12:13:18 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:18 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df" returned: 0 in 0.519s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:18 devstack sudo[104480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac
Nov 05 12:13:18 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:19 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac" returned: 0 in 0.330s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:19 devstack sudo[104485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac
Nov 05 12:13:19 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:19 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df.3f069fb4-a785-4d30-ba86-11facd1109ac" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-3f069fb4-a785-4d30-ba86-11facd1109ac" released by "_delete_snapshot" :: held 1.564s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-cc95af04-9744-4771-9231-dc24e5a8b4df" released by "delete_snapshot" :: held 1.584s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:19 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Created reservations ['52c7f700-81ac-44d2-8092-d6bd1ca561d1', 'd9883ca3-c3a1-423c-a121-1ca3d7c3074b', 'ce285405-df9b-46cb-823e-fc126b353bde', '9f069187-1c8e-4dc5-9adf-193dcba6cc50'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:19 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Delete snapshot completed successfully.
Nov 05 12:13:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0eb39b51-ea3f-4006-b2e4-3755756f377c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-3f069fb4-a785-4d30-ba86-11facd1109ac-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-cc95af04-9744-4771-9231-dc24e5a8b4df-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-cc95af04-9744-4771-9231-dc24e5a8b4df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-quobyte-cc95af04-9744-4771-9231-dc24e5a8b4df" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-cc95af04-9744-4771-9231-dc24e5a8b4df" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[82480af7-8450-413f-917c-21dd4b082ba3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:20 devstack sudo[104488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df
Nov 05 12:13:20 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:20 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df" returned: 0 in 0.402s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:20 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df
Nov 05 12:13:20 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:20 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc95af04-9744-4771-9231-dc24e5a8b4df" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-cc95af04-9744-4771-9231-dc24e5a8b4df" released by "delete_volume" :: held 0.742s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Created reservations ['acaab91c-3d74-4489-996d-135a7c023100', '00c7929a-ec85-402d-b753-c872c78f2424', '1bf24d35-1472-49d9-bc65-2721a885cec5', 'f4896955-64a9-4e9d-b5b1-982e9c4e9e22'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:21 devstack sudo[104497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:21 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:21 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-a5cc8876-d369-4945-9204-c7b8acd38ff4-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.268s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Deleted volume successfully.
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-a5cc8876-d369-4945-9204-c7b8acd38ff4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d70747a7-a485-48c8-a0a9-5a64d3145707 tempest-VolumeDependencyTests-717928617 None] Lock "cinder-cc95af04-9744-4771-9231-dc24e5a8b4df-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "cinder-quobyte-a5cc8876-d369-4945-9204-c7b8acd38ff4" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-a5cc8876-d369-4945-9204-c7b8acd38ff4" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db58dc6-14e7-45d2-81bb-e3abe8c42a48]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:21 devstack sudo[104500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4
Nov 05 12:13:21 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:21 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4" returned: 0 in 0.393s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:21 devstack sudo[104505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4
Nov 05 12:13:21 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:22 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a5cc8876-d369-4945-9204-c7b8acd38ff4" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-quobyte-a5cc8876-d369-4945-9204-c7b8acd38ff4" released by "delete_volume" :: held 0.723s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Created reservations ['0a9b0bd5-598d-4f21-84ee-a9b4a828c66d', 'f1377fee-86ef-4516-b440-f461fa3bc958', 'fd326761-e1da-426a-8a8f-56b6e45fc406', '4cde66e4-0ccb-42a5-a965-0951102393f8'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:22 devstack sudo[104508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:22 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:22 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:22 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Deleted volume successfully.
Nov 05 12:13:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e753c1b5-c0c2-45c5-bbc4-0254eddcd49c tempest-VolumeDependencyTests-717928617 None] Lock "cinder-a5cc8876-d369-4945-9204-c7b8acd38ff4-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Flow 'volume_create_manager' (818041b9-b3b4-4183-be27-71d35d2ab4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85770c77-df46-49d3-8cec-bdbb7307b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85770c77-df46-49d3-8cec-bdbb7307b544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ad5036-1731-434d-adde-22322fc8607f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12de061b32a6404f8098f0026a34ebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:26Z,use_quota=True,user_id='20e370f839cb493a9627f7e700bb6e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55b005e-29af-44a9-b3c5-1cee60598e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55b005e-29af-44a9-b3c5-1cee60598e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1b2f94-c621-4ff0-9450-efe8fb128b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1b2f94-c621-4ff0-9450-efe8fb128b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ad5036-1731-434d-adde-22322fc8607f', 'volume_name': 'volume-78ad5036-1731-434d-adde-22322fc8607f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed7f8b3-814b-4442-8d98-951415f79662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed7f8b3-814b-4442-8d98-951415f79662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31adec3-1194-41ca-bbff-8fe0462df3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:25 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Volume 78ad5036-1731-434d-adde-22322fc8607f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ad5036-1731-434d-adde-22322fc8607f', 'volume_size': 1}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ad5036-1731-434d-adde-22322fc8607f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12de061b32a6404f8098f0026a34ebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:26Z,use_quota=True,user_id='20e370f839cb493a9627f7e700bb6e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Creating volume 78ad5036-1731-434d-adde-22322fc8607f {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:25 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:25 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f 1073741824
Nov 05 12:13:25 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Flow 'volume_create_manager' (15a9794c-aaff-4783-8cb1-bd9aaa8af302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10f2b8e-cfc3-4280-88ec-6c8fdc8c753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10f2b8e-cfc3-4280-88ec-6c8fdc8c753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-567315426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d67eb7-8845-47f4-9243-911481630bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b161ac2c27e542afb0bc50c003961365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:26Z,use_quota=True,user_id='0017063b3f8047bc9feecc4d59f0fe2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ed01c7-3b3f-45e4-b535-6d869f4b88b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ed01c7-3b3f-45e4-b535-6d869f4b88b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f0a9f9-6496-4e84-96c8-e5a0db61059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f0a9f9-6496-4e84-96c8-e5a0db61059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d67eb7-8845-47f4-9243-911481630bda', 'volume_name': 'volume-c8d67eb7-8845-47f4-9243-911481630bda', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f86cfa-8c74-4f4a-bdfe-15e94a4e624a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f86cfa-8c74-4f4a-bdfe-15e94a4e624a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58da0a90-9e20-4b6b-be1e-d7903ea79868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Volume c8d67eb7-8845-47f4-9243-911481630bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d67eb7-8845-47f4-9243-911481630bda', 'volume_size': 1}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:26 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f 1073741824" returned: 0 in 0.503s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:26 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f
Nov 05 12:13:26 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:26 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f" returned: 0 in 0.257s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.433s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-567315426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d67eb7-8845-47f4-9243-911481630bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b161ac2c27e542afb0bc50c003961365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:26Z,use_quota=True,user_id='0017063b3f8047bc9feecc4d59f0fe2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Creating volume c8d67eb7-8845-47f4-9243-911481630bda {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:26 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:26 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda 1073741824
Nov 05 12:13:26 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31adec3-1194-41ca-bbff-8fe0462df3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ad5036-1731-434d-adde-22322fc8607f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9943e8b9-6f9a-4149-9686-8f1bf2398658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:26 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Volume volume-78ad5036-1731-434d-adde-22322fc8607f (78ad5036-1731-434d-adde-22322fc8607f): created successfully
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9943e8b9-6f9a-4149-9686-8f1bf2398658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:26 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Flow 'volume_create_manager' (818041b9-b3b4-4183-be27-71d35d2ab4cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:26 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6a836faa-d9ca-47c5-a213-0729d15d9527 tempest-CinderUnicodeTest-1261253669 None] Created volume successfully.
Nov 05 12:13:27 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda 1073741824" returned: 0 in 0.430s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:27 devstack sudo[104531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda
Nov 05 12:13:27 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:27 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58da0a90-9e20-4b6b-be1e-d7903ea79868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d67eb7-8845-47f4-9243-911481630bda', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f0952b-84ba-41fd-802a-e7e36e04e5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Volume volume-c8d67eb7-8845-47f4-9243-911481630bda (c8d67eb7-8845-47f4-9243-911481630bda): created successfully
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f0952b-84ba-41fd-802a-e7e36e04e5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Flow 'volume_create_manager' (15a9794c-aaff-4783-8cb1-bd9aaa8af302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2a164913-f01b-4aaa-8b64-f9d239c865e2 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Created volume successfully.
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Flow 'volume_create_manager' (247ee077-e317-4151-a8ed-633ec88e5f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceadcf5f-00d9-43d3-afca-9f0c9c030273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceadcf5f-00d9-43d3-afca-9f0c9c030273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-401265359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabf106b-a0b4-4e24-87d7-9e4e26cc6c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12de061b32a6404f8098f0026a34ebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:28Z,use_quota=True,user_id='20e370f839cb493a9627f7e700bb6e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53442bd4-a3b2-4c15-b87c-a456642b4960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53442bd4-a3b2-4c15-b87c-a456642b4960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950c85aa-7ff2-4bc4-8ae1-f64b9fa3554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950c85aa-7ff2-4bc4-8ae1-f64b9fa3554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabf106b-a0b4-4e24-87d7-9e4e26cc6c31', 'volume_name': 'volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e8238-34ae-4084-9c75-74af017618ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e8238-34ae-4084-9c75-74af017618ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf49e1f1-8839-4606-9836-13b96c487aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:28 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Volume fabf106b-a0b4-4e24-87d7-9e4e26cc6c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31', 'volume_size': 1}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-401265359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabf106b-a0b4-4e24-87d7-9e4e26cc6c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12de061b32a6404f8098f0026a34ebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:28Z,use_quota=True,user_id='20e370f839cb493a9627f7e700bb6e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Creating volume fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:28 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:28 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 1073741824
Nov 05 12:13:28 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:28 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 1073741824" returned: 0 in 0.510s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2ed512f5-617f-4ef9-9597-1bdceee93693 req-4ae061a9-06a4-4787-96e3-ba8a99e3e9d1 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:29 devstack sudo[104551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31
Nov 05 12:13:29 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:29 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" returned: 0 in 0.259s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2ed512f5-617f-4ef9-9597-1bdceee93693 req-4ae061a9-06a4-4787-96e3-ba8a99e3e9d1 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.273s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf49e1f1-8839-4606-9836-13b96c487aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92410abe-dc42-40ac-a163-0517e56f5b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [req-2ed512f5-617f-4ef9-9597-1bdceee93693 req-4ae061a9-06a4-4787-96e3-ba8a99e3e9d1 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:29 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Volume volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 (fabf106b-a0b4-4e24-87d7-9e4e26cc6c31): created successfully
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92410abe-dc42-40ac-a163-0517e56f5b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Flow 'volume_create_manager' (247ee077-e317-4151-a8ed-633ec88e5f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:29 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0dceca80-ef77-4521-859b-029cf70069c2 tempest-CinderUnicodeTest-1261253669 None] Created volume successfully.
Nov 05 12:13:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-2ed512f5-617f-4ef9-9597-1bdceee93693 req-4ae061a9-06a4-4787-96e3-ba8a99e3e9d1 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff', 'name': 'volume-c8d67eb7-8845-47f4-9243-911481630bda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e3df739-cfbf-4914-a052-2984e5574ce5', 'enforce_multipath': True} {{(pid=87317) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 12:13:29 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-2ed512f5-617f-4ef9-9597-1bdceee93693 req-4ae061a9-06a4-4787-96e3-ba8a99e3e9d1 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] attachment_update completed successfully.
Nov 05 12:13:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Creating offline snapshot cb7c75d9-7c05-405d-88b1-f2859d9567ef of volume fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:13:30 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[01df480c-42fb-44be-a97a-f437b67975a3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:30 devstack sudo[104969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31
Nov 05 12:13:30 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:31 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" returned: 0 in 0.383s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:31 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef 1G
Nov 05 12:13:31 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:31 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef 1G" returned: 0 in 0.444s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:31 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef
Nov 05 12:13:31 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:31 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef" returned: 0 in 0.315s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:31 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef is being set with open permissions: ugo+rw
Nov 05 12:13:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:31 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef
Nov 05 12:13:31 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef" returned: 0 in 0.268s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack sudo[104989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.info
Nov 05 12:13:32 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.info" returned: 0 in 0.255s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.info is being set with open permissions: ugo+rw
Nov 05 12:13:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:32 devstack sudo[105016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.info
Nov 05 12:13:32 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [req-ee4d55b3-f7ea-4356-ac71-f753653371c5 req-2dc038ec-659a-4be9-a914-82ccf6d52443 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Terminate volume connection completed successfully.
Nov 05 12:13:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [req-ee4d55b3-f7ea-4356-ac71-f753653371c5 req-2dc038ec-659a-4be9-a914-82ccf6d52443 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Deleting attachment 1e3df739-cfbf-4914-a052-2984e5574ce5. {{(pid=87317) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 12:13:32 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.info" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-373c5218-67dd-42b1-a407-82004f0c9ac6 tempest-CinderUnicodeTest-1261253669 None] Create snapshot completed successfully
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Acquiring lock "cinder-c8d67eb7-8845-47f4-9243-911481630bda-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "cinder-c8d67eb7-8845-47f4-9243-911481630bda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=109,cinder:SELECT=98,cinder:INSERT=33,cinder:DELETE=9 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=88,cinder:UPDATE=120,cinder:DELETE=13,cinder:INSERT=21 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Acquiring lock "cinder-quobyte-c8d67eb7-8845-47f4-9243-911481630bda" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "cinder-quobyte-c8d67eb7-8845-47f4-9243-911481630bda" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e44a7-bd94-4e2d-bdac-fc69446d630f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:33 devstack sudo[105023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda
Nov 05 12:13:33 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:33 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "cinder-cb7c75d9-7c05-405d-88b1-f2859d9567ef-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda" returned: 0 in 0.384s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-cb7c75d9-7c05-405d-88b1-f2859d9567ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "cinder-quobyte-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda
Nov 05 12:13:33 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "cinder-quobyte-cb7c75d9-7c05-405d-88b1-f2859d9567ef" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-cb7c75d9-7c05-405d-88b1-f2859d9567ef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Deleting offline snapshot cb7c75d9-7c05-405d-88b1-f2859d9567ef of volume fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] snapshot_file for this snap is: volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ae7b5-8b7a-4c5f-95a7-c0f044887b10]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[105031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef
Nov 05 12:13:34 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c8d67eb7-8845-47f4-9243-911481630bda" returned: 0 in 0.257s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "cinder-quobyte-c8d67eb7-8845-47f4-9243-911481630bda" released by "delete_volume" :: held 0.682s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Created reservations ['401aac6a-f655-4ad6-9929-b07fcb3f7c77', '50f962bf-b867-4529-ac96-b016758ef588', '3290da7b-db58-4346-bee8-9289f1e0fb81', 'bea2e339-e8df-43df-a277-a9942badf7ff'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:34 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07251d3-f55f-4f94-8ce3-4525b5734554]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31
Nov 05 12:13:34 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:34 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:34 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Deleted volume successfully.
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca10f02b-6f67-40da-bb0e-74d7deb7bf05 tempest-TestServerVolumeAttachScenarioOldVersion-1276995057 None] Lock "cinder-c8d67eb7-8845-47f4-9243-911481630bda-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:34 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" returned: 0 in 0.434s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:34 devstack sudo[105046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef
Nov 05 12:13:34 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:35 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef" returned: 0 in 0.511s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:35 devstack sudo[105072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef
Nov 05 12:13:35 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:35 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31.cb7c75d9-7c05-405d-88b1-f2859d9567ef" returned: 0 in 0.283s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-cb7c75d9-7c05-405d-88b1-f2859d9567ef" released by "_delete_snapshot" :: held 1.737s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" released by "delete_snapshot" :: held 1.764s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:35 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Created reservations ['3a5b327c-e03b-46b2-9482-7be11769de89', '091972a4-0f9d-4439-8363-f365a4d73ead', '885c1d7e-d63d-4dca-a65b-a4dd30956e0b', 'cef5dd82-06d7-46c5-9d69-b850136ba06b'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Delete snapshot completed successfully.
Nov 05 12:13:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-503d2107-cccd-406e-b99d-4ee57c430ee3 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-cb7c75d9-7c05-405d-88b1-f2859d9567ef-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "cinder-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "cinder-quobyte-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" acquired by "delete_volume" :: waited 0.036s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b67188-4039-480b-8dd5-c71fc0a011c3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:36 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31
Nov 05 12:13:36 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:36 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" returned: 0 in 0.475s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:36 devstack sudo[105083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31
Nov 05 12:13:36 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:36 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" returned: 0 in 0.251s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31" released by "delete_volume" :: held 0.809s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:36 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Created reservations ['aa7e0d63-f04e-4c7a-86c5-4be608014b88', 'f35bf017-ccc3-490c-8655-6d18364d3739', '43502c77-33fb-4198-bd24-de735c6a79be', '7feb922d-320a-48e1-bc01-39cfc6cf48e3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:37 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "cinder-78ad5036-1731-434d-adde-22322fc8607f-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-78ad5036-1731-434d-adde-22322fc8607f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "cinder-quobyte-78ad5036-1731-434d-adde-22322fc8607f" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-78ad5036-1731-434d-adde-22322fc8607f" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c65b39-8912-4425-8d73-a70094eb65c8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Deleted volume successfully.
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f59ce7cc-0982-43c1-996c-a42b56f6531d tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-fabf106b-a0b4-4e24-87d7-9e4e26cc6c31-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:37 devstack sudo[105089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f
Nov 05 12:13:37 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f" returned: 0 in 0.378s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:37 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f
Nov 05 12:13:37 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:37 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-78ad5036-1731-434d-adde-22322fc8607f" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-quobyte-78ad5036-1731-434d-adde-22322fc8607f" released by "delete_volume" :: held 0.679s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:37 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Created reservations ['2cdeae09-124d-4348-866c-fc502ac9ffbd', 'b3512cdc-36fa-4ba3-98f9-44fc70ea0ba8', 'b1fa596c-99f1-40fd-a78c-ee7dd2aa99b3', 'ea68c659-ed74-4b16-b138-30f20f99184a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:38 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:38 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:38 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.285s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Deleted volume successfully.
Nov 05 12:13:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bb158bff-3d1e-48ca-bbc5-450a00e6cac6 tempest-CinderUnicodeTest-1261253669 None] Lock "cinder-78ad5036-1731-434d-adde-22322fc8607f-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (4da41261-445a-4cd7-8cd7-51a7abcce393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f11761d-f991-45bf-9cdc-00d86c196c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f11761d-f991-45bf-9cdc-00d86c196c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1390542930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fb0869-3e18-4785-9c11-9b8c76f7bf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:47Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971ecb5b-709b-48a8-8bfa-0954be9da413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971ecb5b-709b-48a8-8bfa-0954be9da413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4144e5-7c27-4fa5-a839-6fd5938c6bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4144e5-7c27-4fa5-a839-6fd5938c6bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fb0869-3e18-4785-9c11-9b8c76f7bf0b', 'volume_name': 'volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f052a5f7-1b70-45e4-b9f3-e5a7b312ff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f052a5f7-1b70-45e4-b9f3-e5a7b312ff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6872048-d00c-4992-9a34-021ef128eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:47 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Volume a3fb0869-3e18-4785-9c11-9b8c76f7bf0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b', 'volume_size': 1}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1390542930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fb0869-3e18-4785-9c11-9b8c76f7bf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:47Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Creating volume a3fb0869-3e18-4785-9c11-9b8c76f7bf0b {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:47 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:47 devstack sudo[105104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b 1073741824
Nov 05 12:13:47 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:47 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b 1073741824" returned: 0 in 0.498s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:47 devstack sudo[105111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b
Nov 05 12:13:47 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:48 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6872048-d00c-4992-9a34-021ef128eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69970269-8f59-4174-8b3b-9eb2aea0490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:48 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Volume volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b (a3fb0869-3e18-4785-9c11-9b8c76f7bf0b): created successfully
Nov 05 12:13:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69970269-8f59-4174-8b3b-9eb2aea0490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:48 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (4da41261-445a-4cd7-8cd7-51a7abcce393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:48 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-28a210c0-b6bf-4bb3-a7eb-0020923a11c2 tempest-ProjectReaderTests-283725739 None] Created volume successfully.
Nov 05 12:13:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Lock "cinder-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-quobyte-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:49 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8a69e-e1fb-4a8a-bf31-e38c94c263f5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:49 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b
Nov 05 12:13:49 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b" returned: 0 in 0.405s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:50 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b
Nov 05 12:13:50 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b" returned: 0 in 0.288s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b" released by "delete_volume" :: held 0.743s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Created reservations ['86e3ff00-edbf-4699-99b3-e4382c973ef6', '7a1ed879-9a64-4fba-a4c1-b2cd9e710257', '00414a9e-8db8-4ada-9511-b20a6078279c', 'b9ca6d62-e436-453e-b86f-2c36e8db8f8c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:50 devstack sudo[105122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:50 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:50 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:50 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Deleted volume successfully.
Nov 05 12:13:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6a93f241-b761-4b43-8861-1b8e3132642b tempest-ProjectReaderTests-283725739 None] Lock "cinder-a3fb0869-3e18-4785-9c11-9b8c76f7bf0b-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (7b2cf04a-05b2-40dd-b949-3b802baedd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bd1ccc-f520-4e23-8705-678133ecfa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bd1ccc-f520-4e23-8705-678133ecfa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-810489592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936cb258-738b-4d63-801b-3b1fb5f50ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:51Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ac23d2-be5e-4ca2-8517-469551b35378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ac23d2-be5e-4ca2-8517-469551b35378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ac51c-df70-4aa8-8fa1-1d31c398cb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ac51c-df70-4aa8-8fa1-1d31c398cb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936cb258-738b-4d63-801b-3b1fb5f50ea9', 'volume_name': 'volume-936cb258-738b-4d63-801b-3b1fb5f50ea9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e877b7a0-e933-428b-a009-ef50d2368961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e877b7a0-e933-428b-a009-ef50d2368961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b79d3f1-3fbe-4be2-b0d2-264fbd64dc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume 936cb258-738b-4d63-801b-3b1fb5f50ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936cb258-738b-4d63-801b-3b1fb5f50ea9', 'volume_size': 1}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-810489592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936cb258-738b-4d63-801b-3b1fb5f50ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:51Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Creating volume 936cb258-738b-4d63-801b-3b1fb5f50ea9 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:51 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:51 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9 1073741824
Nov 05 12:13:51 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (fc6549bd-47e5-41bf-84ff-10ded93dc2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d166d4-10f5-4e73-8ef6-e8f1e1e03e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d166d4-10f5-4e73-8ef6-e8f1e1e03e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523305461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b745ea-ed64-45d8-ae7a-39e636e44e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:51Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309070e8-bff0-4d6e-81b3-f9c23d83b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309070e8-bff0-4d6e-81b3-f9c23d83b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd062eb2-be13-4f93-9760-ba3a26a60482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd062eb2-be13-4f93-9760-ba3a26a60482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b745ea-ed64-45d8-ae7a-39e636e44e91', 'volume_name': 'volume-51b745ea-ed64-45d8-ae7a-39e636e44e91', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e3a8af-edbf-4823-a130-d75cb9254104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e3a8af-edbf-4823-a130-d75cb9254104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b1d2e6-c7c9-4a3c-ada4-3ffb17857024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:51 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Volume 51b745ea-ed64-45d8-ae7a-39e636e44e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b745ea-ed64-45d8-ae7a-39e636e44e91', 'volume_size': 1}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:51 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9 1073741824" returned: 0 in 0.439s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:51 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9
Nov 05 12:13:51 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:52 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9" returned: 0 in 0.245s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523305461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b745ea-ed64-45d8-ae7a-39e636e44e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:51Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Creating volume 51b745ea-ed64-45d8-ae7a-39e636e44e91 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:52 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b79d3f1-3fbe-4be2-b0d2-264fbd64dc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936cb258-738b-4d63-801b-3b1fb5f50ea9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:52 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91 1073741824
Nov 05 12:13:52 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef93e4f-a09d-460d-b40e-5c8b333bfa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:52 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume volume-936cb258-738b-4d63-801b-3b1fb5f50ea9 (936cb258-738b-4d63-801b-3b1fb5f50ea9): created successfully
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef93e4f-a09d-460d-b40e-5c8b333bfa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (7b2cf04a-05b2-40dd-b949-3b802baedd20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-93e2cd86-caae-4f08-9e8b-c762f59079b9 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created volume successfully.
Nov 05 12:13:52 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91 1073741824" returned: 0 in 0.420s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:52 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91
Nov 05 12:13:52 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:52 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91" returned: 0 in 0.237s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b1d2e6-c7c9-4a3c-ada4-3ffb17857024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b745ea-ed64-45d8-ae7a-39e636e44e91', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7044de-c7f6-4922-9f6e-2d9215bc0ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:52 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Volume volume-51b745ea-ed64-45d8-ae7a-39e636e44e91 (51b745ea-ed64-45d8-ae7a-39e636e44e91): created successfully
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7044de-c7f6-4922-9f6e-2d9215bc0ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (fc6549bd-47e5-41bf-84ff-10ded93dc2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3d322180-84dd-424a-a521-b0ee331b7072 tempest-ProjectReaderTests-283725739 None] Created volume successfully.
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-51b745ea-ed64-45d8-ae7a-39e636e44e91-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Lock "cinder-51b745ea-ed64-45d8-ae7a-39e636e44e91-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-quobyte-51b745ea-ed64-45d8-ae7a-39e636e44e91" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-51b745ea-ed64-45d8-ae7a-39e636e44e91" acquired by "delete_volume" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f2e57-4d4b-40aa-b06c-f3e46277368d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:53 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91
Nov 05 12:13:53 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (416e9a3d-06fc-475d-a832-8f590597e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7653c955-cccc-4076-a276-cd763b9de994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7653c955-cccc-4076-a276-cd763b9de994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860349174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a38c5-452e-4b1b-a4e0-5e9ae7a537f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:54Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da40335-0359-4e64-9944-183e480c83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da40335-0359-4e64-9944-183e480c83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcb4f6d-6c05-42f8-9998-8b5f9f39501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcb4f6d-6c05-42f8-9998-8b5f9f39501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761a38c5-452e-4b1b-a4e0-5e9ae7a537f5', 'volume_name': 'volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd0958a-682d-4918-8577-e6687976fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd0958a-682d-4918-8577-e6687976fac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19faa5d1-77ac-4fd1-a9ca-1fb84a02cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:53 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume 761a38c5-452e-4b1b-a4e0-5e9ae7a537f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5', 'volume_size': 1}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860349174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a38c5-452e-4b1b-a4e0-5e9ae7a537f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:54Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Creating volume 761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:53 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:53 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 1073741824
Nov 05 12:13:53 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:54 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91" returned: 0 in 0.428s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:54 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91
Nov 05 12:13:54 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (6d00a3b7-5302-4016-9723-6f0561a5e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b1828d-7f93-453f-b707-1b8851b36d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b1828d-7f93-453f-b707-1b8851b36d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205667027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1967d3-0d0e-4c71-943c-68227f198769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:54Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c02e9c-45a4-455e-8af5-aecd072b8a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c02e9c-45a4-455e-8af5-aecd072b8a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638db0a8-3b06-4ef6-8e0a-8e6e1ff07a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638db0a8-3b06-4ef6-8e0a-8e6e1ff07a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1967d3-0d0e-4c71-943c-68227f198769', 'volume_name': 'volume-fb1967d3-0d0e-4c71-943c-68227f198769', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e48428-bd36-4b7c-8f8b-02658b1ee84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e48428-bd36-4b7c-8f8b-02658b1ee84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a1a9c3-25da-4251-a40f-648705df4c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume fb1967d3-0d0e-4c71-943c-68227f198769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1967d3-0d0e-4c71-943c-68227f198769', 'volume_size': 1}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:54 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-51b745ea-ed64-45d8-ae7a-39e636e44e91" returned: 0 in 0.357s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-51b745ea-ed64-45d8-ae7a-39e636e44e91" released by "delete_volume" :: held 0.852s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:54 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 1073741824" returned: 0 in 0.597s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Created reservations ['bccb731a-8691-4558-9124-67c08731e3e1', 'ccc490b3-963d-4753-83ab-f278999f5c07', '66c0ce71-431b-4634-862a-e8dd6d0e76b4', '14a008ec-fba1-4d78-81bd-826b76c2a694'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:54 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5
Nov 05 12:13:54 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (b218804e-1ecf-4c6a-8426-332bb74d6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b398c5e-9bbb-480c-b7b1-2605d1f1ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b398c5e-9bbb-480c-b7b1-2605d1f1ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936428357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11442e9-187a-4adb-933e-f919c220695c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a9da58-626b-4750-959a-b3a663426d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a9da58-626b-4750-959a-b3a663426d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:54 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4cacde-ae08-4ff7-bed9-080ab00846ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4cacde-ae08-4ff7-bed9-080ab00846ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11442e9-187a-4adb-933e-f919c220695c', 'volume_name': 'volume-c11442e9-187a-4adb-933e-f919c220695c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb962ad4-f1bc-4d7f-b8d9-add4ff36d5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb962ad4-f1bc-4d7f-b8d9-add4ff36d5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff43276b-bd56-40f0-87ae-9ebfdcfc56ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume c11442e9-187a-4adb-933e-f919c220695c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11442e9-187a-4adb-933e-f919c220695c', 'volume_size': 1}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:54 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205667027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1967d3-0d0e-4c71-943c-68227f198769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:54Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Creating volume fb1967d3-0d0e-4c71-943c-68227f198769 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:54 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:54 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769 1073741824
Nov 05 12:13:54 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19faa5d1-77ac-4fd1-a9ca-1fb84a02cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efec5a4-ff47-4841-99de-5a22ac8a718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 (761a38c5-452e-4b1b-a4e0-5e9ae7a537f5): created successfully
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efec5a4-ff47-4841-99de-5a22ac8a718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (416e9a3d-06fc-475d-a832-8f590597e76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:55 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.407s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Deleted volume successfully.
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-21a6733c-1b2a-472a-9e4e-a054d3a414c8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created volume successfully.
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9d69cb6f-7de8-4d83-8c1d-828b21a65c08 tempest-ProjectReaderTests-283725739 None] Lock "cinder-51b745ea-ed64-45d8-ae7a-39e636e44e91-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (cc9c2f48-8293-44ed-98f1-9b47c92484fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86444e3-287f-4895-95b6-8cd797087851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86444e3-287f-4895-95b6-8cd797087851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-939007360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cbbb7a-6922-4ba9-8224-083a7a51d50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fccf8f-801a-4944-8297-ed044ada7350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fccf8f-801a-4944-8297-ed044ada7350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d379120-99ae-49b0-8fcc-4b9f33743232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d379120-99ae-49b0-8fcc-4b9f33743232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02cbbb7a-6922-4ba9-8224-083a7a51d50e', 'volume_name': 'volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e05b6-0c6a-4679-be34-3435d168f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e05b6-0c6a-4679-be34-3435d168f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81ce711-c396-4a02-a924-e9cddd322e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume 02cbbb7a-6922-4ba9-8224-083a7a51d50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e', 'volume_size': 1}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:55 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769 1073741824" returned: 0 in 0.580s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:55 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769
Nov 05 12:13:55 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (c31f11b2-c056-453a-b47e-14ee5ef0eeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0e5fe5-8bb1-4568-997a-a3234fede06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0e5fe5-8bb1-4568-997a-a3234fede06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519564500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fde2ae-387e-4535-b7ca-ce23396d777f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1607a29-c3aa-4bb0-b024-0cf664c702f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1607a29-c3aa-4bb0-b024-0cf664c702f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4a87a9-66ce-4d71-9165-695c468086cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4a87a9-66ce-4d71-9165-695c468086cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32fde2ae-387e-4535-b7ca-ce23396d777f', 'volume_name': 'volume-32fde2ae-387e-4535-b7ca-ce23396d777f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db22a62-f537-4baa-8974-df97b1331650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db22a62-f537-4baa-8974-df97b1331650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730ff96e-09d0-49f8-84f8-01d17aa9b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Volume 32fde2ae-387e-4535-b7ca-ce23396d777f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32fde2ae-387e-4535-b7ca-ce23396d777f', 'volume_size': 1}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (1b096ea4-696d-4e26-ac2e-9814700e5b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a70302-25a7-4621-b495-f1447d2f8b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a70302-25a7-4621-b495-f1447d2f8b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473298835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762fcd74-eb22-4621-bb49-188aefc34db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:56Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4288d9b7-a1f6-48aa-9073-b08743e1f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4288d9b7-a1f6-48aa-9073-b08743e1f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a852c7-81ad-43d9-bd12-2c7c8d719e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a852c7-81ad-43d9-bd12-2c7c8d719e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762fcd74-eb22-4621-bb49-188aefc34db4', 'volume_name': 'volume-762fcd74-eb22-4621-bb49-188aefc34db4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0444a7b5-13ec-4a07-b074-6ffb42e27c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0444a7b5-13ec-4a07-b074-6ffb42e27c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e8ca36-6f08-43a9-8d27-e019e4af04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume 762fcd74-eb22-4621-bb49-188aefc34db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762fcd74-eb22-4621-bb49-188aefc34db4', 'volume_size': 1}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769" returned: 0 in 0.303s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.089s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936428357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11442e9-187a-4adb-933e-f919c220695c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Creating volume c11442e9-187a-4adb-933e-f919c220695c {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a1a9c3-25da-4251-a40f-648705df4c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1967d3-0d0e-4c71-943c-68227f198769', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f22038-bf6c-46a1-84f0-c920434b9cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:55 devstack sudo[105174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c 1073741824
Nov 05 12:13:55 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume volume-fb1967d3-0d0e-4c71-943c-68227f198769 (fb1967d3-0d0e-4c71-943c-68227f198769): created successfully
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f22038-bf6c-46a1-84f0-c920434b9cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (6d00a3b7-5302-4016-9723-6f0561a5e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f2853228-202b-4ca6-b7fc-029700ba0f09 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created volume successfully.
Nov 05 12:13:56 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c 1073741824" returned: 0 in 0.489s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack sudo[105180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c
Nov 05 12:13:56 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.263s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-939007360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cbbb7a-6922-4ba9-8224-083a7a51d50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Creating volume 02cbbb7a-6922-4ba9-8224-083a7a51d50e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:56 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff43276b-bd56-40f0-87ae-9ebfdcfc56ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11442e9-187a-4adb-933e-f919c220695c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:56 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e 1073741824
Nov 05 12:13:56 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034f6c4d-2eba-4cac-bc79-bffb2f467811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume volume-c11442e9-187a-4adb-933e-f919c220695c (c11442e9-187a-4adb-933e-f919c220695c): created successfully
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034f6c4d-2eba-4cac-bc79-bffb2f467811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (b218804e-1ecf-4c6a-8426-332bb74d6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-91661574-d1f7-49e5-be0e-cbec2bbfac7a tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created volume successfully.
Nov 05 12:13:57 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e 1073741824" returned: 0 in 0.437s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:57 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e
Nov 05 12:13:57 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:57 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.660s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519564500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fde2ae-387e-4535-b7ca-ce23396d777f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:55Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Creating volume 32fde2ae-387e-4535-b7ca-ce23396d777f {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:57 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81ce711-c396-4a02-a924-e9cddd322e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad7e283-7d72-4dc6-b40b-aaa1f2ae3154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:57 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f 1073741824
Nov 05 12:13:57 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e (02cbbb7a-6922-4ba9-8224-083a7a51d50e): created successfully
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad7e283-7d72-4dc6-b40b-aaa1f2ae3154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (cc9c2f48-8293-44ed-98f1-9b47c92484fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-17bd7ed5-a7fc-46e2-8f57-b06e4cfd65a8 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created volume successfully.
Nov 05 12:13:57 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f 1073741824" returned: 0 in 0.501s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:57 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f
Nov 05 12:13:57 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:58 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f" returned: 0 in 0.286s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.396s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473298835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762fcd74-eb22-4621-bb49-188aefc34db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abc985fe0b04f158219dd8e70984fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:13:56Z,use_quota=True,user_id='7342390034f04bfd8d2d7849feba9472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Creating volume 762fcd74-eb22-4621-bb49-188aefc34db4 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:13:58 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730ff96e-09d0-49f8-84f8-01d17aa9b82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32fde2ae-387e-4535-b7ca-ce23396d777f', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:58 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4 1073741824
Nov 05 12:13:58 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d0d3d1-bec6-4073-acc7-6a8f50203412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Volume volume-32fde2ae-387e-4535-b7ca-ce23396d777f (32fde2ae-387e-4535-b7ca-ce23396d777f): created successfully
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d0d3d1-bec6-4073-acc7-6a8f50203412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (c31f11b2-c056-453a-b47e-14ee5ef0eeaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-00bfdfa8-8cc6-4300-a915-dd03666e5283 tempest-ProjectReaderTests-283725739 None] Created volume successfully.
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-32fde2ae-387e-4535-b7ca-ce23396d777f-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Lock "cinder-32fde2ae-387e-4535-b7ca-ce23396d777f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-quobyte-32fde2ae-387e-4535-b7ca-ce23396d777f" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-32fde2ae-387e-4535-b7ca-ce23396d777f" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8dcf1c-f2d7-4cb7-9a79-75fe9d3a7f8a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:58 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4 1073741824" returned: 0 in 0.530s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:58 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f
Nov 05 12:13:58 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:58 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4
Nov 05 12:13:58 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:59 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f" returned: 0 in 0.412s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:59 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4" returned: 0 in 0.287s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:59 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f
Nov 05 12:13:59 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e8ca36-6f08-43a9-8d27-e019e4af04b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762fcd74-eb22-4621-bb49-188aefc34db4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff627257-289e-4a0d-a15f-4d03deff57e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:13:59 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Volume volume-762fcd74-eb22-4621-bb49-188aefc34db4 (762fcd74-eb22-4621-bb49-188aefc34db4): created successfully
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff627257-289e-4a0d-a15f-4d03deff57e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Flow 'volume_create_manager' (1b096ea4-696d-4e26-ac2e-9814700e5b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:13:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cd827a82-da96-4582-825c-d26b00baa544 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created volume successfully.
Nov 05 12:13:59 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-32fde2ae-387e-4535-b7ca-ce23396d777f" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-32fde2ae-387e-4535-b7ca-ce23396d777f" released by "delete_volume" :: held 0.714s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Created reservations ['4682e1cf-56a4-4e60-99e1-e64f46701bc8', '6ead84a7-f04c-4948-8810-2a0bac95bedb', '82b7db65-b237-458a-a42c-1f49548ab54a', 'af0df43f-0ba6-455f-8e2a-5837a3711615'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:13:59 devstack sudo[105223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:13:59 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:13:59 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.270s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:13:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Deleted volume successfully.
Nov 05 12:13:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-66ddae1e-b2da-4b57-8f1e-b73c4256519c tempest-ProjectReaderTests-283725739 None] Lock "cinder-32fde2ae-387e-4535-b7ca-ce23396d777f-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-762fcd74-eb22-4621-bb49-188aefc34db4-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-762fcd74-eb22-4621-bb49-188aefc34db4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-quobyte-762fcd74-eb22-4621-bb49-188aefc34db4" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-762fcd74-eb22-4621-bb49-188aefc34db4" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9f2d7c-68d1-4dba-a1f2-57de6bbc4ccd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (0776d741-bb94-4999-b14b-4e35f10c1337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f8e51b-deca-4a3c-8fa8-4f3c532bd2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:00 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4
Nov 05 12:14:00 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f8e51b-deca-4a3c-8fa8-4f3c532bd2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564784292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:00Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346667a5-d316-44ce-85fb-5e970935b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346667a5-d316-44ce-85fb-5e970935b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d237c298-169c-4912-bc18-7644de59ed33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d237c298-169c-4912-bc18-7644de59ed33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8', 'volume_name': 'volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9367f32a-713d-4e7d-8b25-f98f0bb5c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9367f32a-713d-4e7d-8b25-f98f0bb5c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0354b93-98a4-4ae2-bb59-74a7a7ab00d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:00 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Volume 42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8', 'volume_size': 1}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564784292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0953d90712974aa396acc3df295f81f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:00Z,use_quota=True,user_id='82a766e5e77241ea94849c0c870d96ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Creating volume 42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:00 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:00 devstack sudo[105228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 1073741824
Nov 05 12:14:00 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:00 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4" returned: 0 in 0.411s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:00 devstack sudo[105233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4
Nov 05 12:14:00 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:00 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-762fcd74-eb22-4621-bb49-188aefc34db4" returned: 0 in 0.256s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:00 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 1073741824" returned: 0 in 0.483s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-762fcd74-eb22-4621-bb49-188aefc34db4" released by "delete_volume" :: held 0.725s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:00 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8
Nov 05 12:14:00 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:00 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created reservations ['8f6193ba-ce0b-4738-b7e9-bbd148a1e8fd', 'd8aa7f48-a02a-408c-9c33-f5418f5da371', '00a81994-ffd4-46a0-b4a9-d1f65cf71550', '67372d0a-47e5-4494-816e-82563406921b'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:01 devstack sudo[105241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:01 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:01 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8" returned: 0 in 0.286s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0354b93-98a4-4ae2-bb59-74a7a7ab00d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b329258-bf22-499c-a633-0ac02da3a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:01 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Volume volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 (42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8): created successfully
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b329258-bf22-499c-a633-0ac02da3a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Flow 'volume_create_manager' (0776d741-bb94-4999-b14b-4e35f10c1337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-02cbbb7a-6922-4ba9-8224-083a7a51d50e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-380775e9-a7eb-4d0c-b753-3dc93e74cf09 tempest-ProjectReaderTests-283725739 None] Created volume successfully.
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-02cbbb7a-6922-4ba9-8224-083a7a51d50e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-quobyte-02cbbb7a-6922-4ba9-8224-083a7a51d50e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:01 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.304s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Deleted volume successfully.
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-02cbbb7a-6922-4ba9-8224-083a7a51d50e" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[838bd78a-3432-4e5c-a412-1611627d5f21]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8da21c95-e38f-4948-a6d7-ab0d8209379c tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-762fcd74-eb22-4621-bb49-188aefc34db4-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:01 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e
Nov 05 12:14:01 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:01 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e" returned: 0 in 0.400s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:01 devstack sudo[105250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e
Nov 05 12:14:01 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:02 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-02cbbb7a-6922-4ba9-8224-083a7a51d50e" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-02cbbb7a-6922-4ba9-8224-083a7a51d50e" released by "delete_volume" :: held 0.727s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created reservations ['cebaa99d-411f-4c98-91d6-6b2a521891b4', '26502305-a5a2-4d7c-a53d-b19521a04a42', '43556faa-91a8-4942-a392-4b7aeb0ffeaa', 'b02e04a5-1e50-4aa0-b8ac-c3fb62ec6b8e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:02 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:02 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Lock "cinder-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Acquiring lock "cinder-quobyte-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-c11442e9-187a-4adb-933e-f919c220695c-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8" acquired by "delete_volume" :: waited 0.029s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:02 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-c11442e9-187a-4adb-933e-f919c220695c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Deleted volume successfully.
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ece22-e2be-4ba8-9606-6ce5a3bbcc60]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c65b26e-2416-45bf-bb0a-f55241af25f5 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-02cbbb7a-6922-4ba9-8224-083a7a51d50e-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-quobyte-c11442e9-187a-4adb-933e-f919c220695c" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-c11442e9-187a-4adb-933e-f919c220695c" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b4ba8-0323-4d27-855d-1c01fb28c5c4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:02 devstack sudo[105256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8
Nov 05 12:14:02 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:02 devstack sudo[105259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c
Nov 05 12:14:02 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8" returned: 0 in 0.477s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:03 devstack sudo[105268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8
Nov 05 12:14:03 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c" returned: 0 in 0.403s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:03 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c
Nov 05 12:14:03 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Lock "cinder-quobyte-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8" released by "delete_volume" :: held 0.823s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:03 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c11442e9-187a-4adb-933e-f919c220695c" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-c11442e9-187a-4adb-933e-f919c220695c" released by "delete_volume" :: held 0.746s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Created reservations ['6d10c482-a8e7-4470-808f-fae44274ff59', '71f856b1-67a9-4230-80d8-480855d711ba', 'a79d4fca-539d-48cc-b3f2-879c4c79c21d', 'edf1b063-219c-4c48-9f43-59def5fc4709'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created reservations ['c27ab800-d6e4-40d6-9e0f-9452a2fec3e2', '2fd36385-7515-407e-a7ac-6c66d7c17836', '31fe7c34-bbf6-4a3e-8b00-bbc154460c6e', '4fd9a8c7-0aef-471d-af42-70a4b4c86e26'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:03 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:03 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:03 devstack sudo[105276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:03 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-fb1967d3-0d0e-4c71-943c-68227f198769-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-fb1967d3-0d0e-4c71-943c-68227f198769-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-quobyte-fb1967d3-0d0e-4c71-943c-68227f198769" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-fb1967d3-0d0e-4c71-943c-68227f198769" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:03 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.351s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Deleted volume successfully.
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c0dbe8-0dc3-4ed5-b079-b08e605a3abd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1bde9009-2075-4b3e-92e8-47a36b13fc9a tempest-ProjectReaderTests-283725739 None] Lock "cinder-42c76a85-e9dc-4e25-9ff5-0fe789e6f5a8-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:03 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.389s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Deleted volume successfully.
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ed3aed8a-bb0f-4838-a5a7-103528462c89 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-c11442e9-187a-4adb-933e-f919c220695c-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:04 devstack sudo[105279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769
Nov 05 12:14:04 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:04 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769" returned: 0 in 0.447s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:04 devstack sudo[105286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769
Nov 05 12:14:04 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:04 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb1967d3-0d0e-4c71-943c-68227f198769" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-fb1967d3-0d0e-4c71-943c-68227f198769" released by "delete_volume" :: held 0.809s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created reservations ['bac21e31-247d-49a8-944d-747dcaa4733d', 'b2cda402-4c64-4414-a8a6-2fa124ae4344', '8c932bf9-f24f-4ba9-8a3f-45b8a7fd4a99', '91f3f5e6-71d7-49c8-bca4-5befecb60576'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:04 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:04 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-quobyte-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd5daad-7670-479f-a399-ab29fb76032d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:05 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.317s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Deleted volume successfully.
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6e81a699-322c-4572-be78-8722001b34c0 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-fb1967d3-0d0e-4c71-943c-68227f198769-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:05 devstack sudo[105291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5
Nov 05 12:14:05 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:05 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5" returned: 0 in 0.429s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:05 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5
Nov 05 12:14:05 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:05 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5" returned: 0 in 0.260s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5" released by "delete_volume" :: held 0.742s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created reservations ['a8fc52b6-3a00-4401-9af7-1e20101aad4a', 'bc452b68-5f3a-409d-8efc-d4e9fdf17fea', '23f86499-6807-4164-b668-864f40c80d40', '1652ddf7-d463-41e6-aba8-9f374e2c9a25'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:05 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:05 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-936cb258-738b-4d63-801b-3b1fb5f50ea9-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-936cb258-738b-4d63-801b-3b1fb5f50ea9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:06 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "cinder-quobyte-936cb258-738b-4d63-801b-3b1fb5f50ea9" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Deleted volume successfully.
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-936cb258-738b-4d63-801b-3b1fb5f50ea9" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3e5ff183-bda9-4a73-9d6d-48a980a6f528 tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-761a38c5-452e-4b1b-a4e0-5e9ae7a537f5-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3e574b-5b0f-4bbe-8923-7c6541220261]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:06 devstack sudo[105303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9
Nov 05 12:14:06 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:06 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9" returned: 0 in 0.386s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:06 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9
Nov 05 12:14:06 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:06 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-936cb258-738b-4d63-801b-3b1fb5f50ea9" returned: 0 in 0.271s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-quobyte-936cb258-738b-4d63-801b-3b1fb5f50ea9" released by "delete_volume" :: held 0.701s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:06 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Created reservations ['33d512ca-970a-4b72-9ce6-5fdc7f3d8d7e', 'a7ed0b86-3adb-467f-b5ca-d0686439ae04', '00520b77-7634-4a6f-bc51-06dccc91e766', '2dc20228-0215-4232-9980-2b51fde9a03e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:07 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:07 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:07 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Deleted volume successfully.
Nov 05 12:14:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ea464ba2-2ac0-45b3-8d6a-49bef4c8aefb tempest-CreateVolumesFromSourceVolumeTest-1097555126 None] Lock "cinder-936cb258-738b-4d63-801b-3b1fb5f50ea9-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Flow 'volume_create_manager' (b0adaf84-2424-4751-8d49-65d4f9ff7e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3054aa-4e2b-460a-9a09-fad0cc5d82d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3054aa-4e2b-460a-9a09-fad0cc5d82d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371669432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084a404e-2776-41b0-89de-1b554cd53ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a990d48d50434497ab3e906fbbcc301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:11Z,use_quota=True,user_id='9319c72a91dc4554968b679135b1e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c8909e-5622-45cf-9e96-345e3fc5618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c8909e-5622-45cf-9e96-345e3fc5618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b205bc4a-18ec-44d9-9b99-c37088587e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b205bc4a-18ec-44d9-9b99-c37088587e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084a404e-2776-41b0-89de-1b554cd53ff1', 'volume_name': 'volume-084a404e-2776-41b0-89de-1b554cd53ff1', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b48c4-5b46-472d-8a7b-2f4359384583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b48c4-5b46-472d-8a7b-2f4359384583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddca6db-2cf5-452a-ae34-837d28bd4f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:10 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Volume 084a404e-2776-41b0-89de-1b554cd53ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084a404e-2776-41b0-89de-1b554cd53ff1', 'volume_size': 1}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371669432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084a404e-2776-41b0-89de-1b554cd53ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a990d48d50434497ab3e906fbbcc301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:11Z,use_quota=True,user_id='9319c72a91dc4554968b679135b1e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Creating volume 084a404e-2776-41b0-89de-1b554cd53ff1 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:10 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:10 devstack sudo[105314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1 1073741824
Nov 05 12:14:10 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:11 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1 1073741824" returned: 0 in 0.424s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:11 devstack sudo[105320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1
Nov 05 12:14:11 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:11 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddca6db-2cf5-452a-ae34-837d28bd4f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084a404e-2776-41b0-89de-1b554cd53ff1', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af743c5-8d8d-4e0d-b9f0-f5fdf9631640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:11 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Volume volume-084a404e-2776-41b0-89de-1b554cd53ff1 (084a404e-2776-41b0-89de-1b554cd53ff1): created successfully
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af743c5-8d8d-4e0d-b9f0-f5fdf9631640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:11 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Flow 'volume_create_manager' (b0adaf84-2424-4751-8d49-65d4f9ff7e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b3dc9de6-0129-4a32-8166-2d4248f9d387 tempest-ProjectReaderTests-351271796 None] Created volume successfully.
Nov 05 12:14:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Acquiring lock "cinder-084a404e-2776-41b0-89de-1b554cd53ff1-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Lock "cinder-084a404e-2776-41b0-89de-1b554cd53ff1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Acquiring lock "cinder-quobyte-084a404e-2776-41b0-89de-1b554cd53ff1" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Lock "cinder-quobyte-084a404e-2776-41b0-89de-1b554cd53ff1" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0670205f-8dcb-4dfe-b769-50f890fc2464]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1
Nov 05 12:14:13 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1" returned: 0 in 0.422s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1
Nov 05 12:14:13 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-084a404e-2776-41b0-89de-1b554cd53ff1" returned: 0 in 0.240s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Lock "cinder-quobyte-084a404e-2776-41b0-89de-1b554cd53ff1" released by "delete_volume" :: held 0.727s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:13 devstack sudo[105367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:13 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Created reservations ['f8a91272-e717-4011-bcf9-8b83553e6227', 'a2ac7bfa-60c6-4b6a-a2c3-ea109a156761', '33574d20-a8a8-48b7-a072-c8b2aa2830c9', 'e880e323-aef0-4757-a59c-5f78f6878150'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:13 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:13 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:13 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:14:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:14:14 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.268s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:14 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Deleted volume successfully.
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5c6abd28-4502-49f3-8df8-23b9c7165d24 tempest-ProjectReaderTests-351271796 None] Lock "cinder-084a404e-2776-41b0-89de-1b554cd53ff1-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Flow 'volume_create_manager' (2e10941c-c3d3-413e-af54-a715d59482f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db06832d-16f4-4c63-a1f2-05138a71a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db06832d-16f4-4c63-a1f2-05138a71a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041220435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b3bfd5-c654-4321-a54f-810f84a26239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a990d48d50434497ab3e906fbbcc301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:14Z,use_quota=True,user_id='9319c72a91dc4554968b679135b1e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee426e4-ff3e-4d67-a60f-4666b2e6a351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee426e4-ff3e-4d67-a60f-4666b2e6a351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e1315c-3a60-43ab-8cd7-3753e413320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e1315c-3a60-43ab-8cd7-3753e413320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b3bfd5-c654-4321-a54f-810f84a26239', 'volume_name': 'volume-31b3bfd5-c654-4321-a54f-810f84a26239', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f44378-0c34-44a8-9527-7647324786aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f44378-0c34-44a8-9527-7647324786aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ff4512-76e6-4a04-8ad1-01a189713253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:14 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Volume 31b3bfd5-c654-4321-a54f-810f84a26239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b3bfd5-c654-4321-a54f-810f84a26239', 'volume_size': 1}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041220435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b3bfd5-c654-4321-a54f-810f84a26239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a990d48d50434497ab3e906fbbcc301f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:14Z,use_quota=True,user_id='9319c72a91dc4554968b679135b1e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Creating volume 31b3bfd5-c654-4321-a54f-810f84a26239 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:14 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:14 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239 1073741824
Nov 05 12:14:14 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:15 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239 1073741824" returned: 0 in 0.428s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:15 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239
Nov 05 12:14:15 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:15 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239" returned: 0 in 0.266s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ff4512-76e6-4a04-8ad1-01a189713253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b3bfd5-c654-4321-a54f-810f84a26239', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e38ae06-9a68-48f8-af0b-4ff4065ac55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:15 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Volume volume-31b3bfd5-c654-4321-a54f-810f84a26239 (31b3bfd5-c654-4321-a54f-810f84a26239): created successfully
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e38ae06-9a68-48f8-af0b-4ff4065ac55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Flow 'volume_create_manager' (2e10941c-c3d3-413e-af54-a715d59482f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:15 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f85ff49f-9444-4dee-be70-5272c0566515 tempest-ProjectReaderTests-351271796 None] Created volume successfully.
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Acquiring lock "cinder-31b3bfd5-c654-4321-a54f-810f84a26239-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Lock "cinder-31b3bfd5-c654-4321-a54f-810f84a26239-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Acquiring lock "cinder-quobyte-31b3bfd5-c654-4321-a54f-810f84a26239" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Lock "cinder-quobyte-31b3bfd5-c654-4321-a54f-810f84a26239" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fced81a5-8118-4de1-8836-513d69b4a826]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:15 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239
Nov 05 12:14:15 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:16 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239" returned: 0 in 0.418s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:16 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239
Nov 05 12:14:16 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:16 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-31b3bfd5-c654-4321-a54f-810f84a26239" returned: 0 in 0.269s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Lock "cinder-quobyte-31b3bfd5-c654-4321-a54f-810f84a26239" released by "delete_volume" :: held 0.731s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Created reservations ['4092a9d5-b47e-44f0-9a1e-afefeeee4134', '3cdcccd5-60be-4f78-ac27-c1c8cecf9591', 'd9db5971-2ee7-4c22-8db6-9ef5d79bb605', '64f39508-5500-421f-b1ff-15031d7e4620'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:16 devstack sudo[105390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:16 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:16 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.248s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:16 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Deleted volume successfully.
Nov 05 12:14:16 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e819a031-bd7e-4a7a-8d19-50e16356f5c8 tempest-ProjectReaderTests-351271796 None] Lock "cinder-31b3bfd5-c654-4321-a54f-810f84a26239-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:26 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=116,cinder:INSERT=31,cinder:UPDATE=153,cinder:DELETE=15 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:14:26 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=93,cinder:INSERT=45,cinder:UPDATE=170,cinder:DELETE=12 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (8943054d-4a1e-46eb-933c-6daad08939c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfb6150-8355-470b-b5b1-e670b02def4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfb6150-8355-470b-b5b1-e670b02def4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575405671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa37480-792c-4e32-a2b3-a90d150f0b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:29Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5ee201-2044-4cc4-8dfe-10c64ce38ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5ee201-2044-4cc4-8dfe-10c64ce38ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1ae84d-3a1e-4e83-b5f1-97a57434762f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1ae84d-3a1e-4e83-b5f1-97a57434762f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa37480-792c-4e32-a2b3-a90d150f0b55', 'volume_name': 'volume-8aa37480-792c-4e32-a2b3-a90d150f0b55', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130d2a6b-62e0-4030-9d00-3b348c651169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130d2a6b-62e0-4030-9d00-3b348c651169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee907ce8-803a-46d0-b0b5-907008a962ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume 8aa37480-792c-4e32-a2b3-a90d150f0b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa37480-792c-4e32-a2b3-a90d150f0b55', 'volume_size': 1}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575405671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa37480-792c-4e32-a2b3-a90d150f0b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:29Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Creating volume 8aa37480-792c-4e32-a2b3-a90d150f0b55 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:29 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:29 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55 1073741824
Nov 05 12:14:29 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (87b890fb-20db-4c6e-90c6-70dc8d964f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63490083-c4b2-43be-9179-47ef92a62090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63490083-c4b2-43be-9179-47ef92a62090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706743476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c26539-b730-4b19-81c4-3152b16b76b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:30Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc3dc64-e5e2-4a14-ac80-817a63f18bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc3dc64-e5e2-4a14-ac80-817a63f18bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f92960-658b-4f08-b9e7-03952c9705d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f92960-658b-4f08-b9e7-03952c9705d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c26539-b730-4b19-81c4-3152b16b76b9', 'volume_name': 'volume-e5c26539-b730-4b19-81c4-3152b16b76b9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a59730-3f5c-4980-8c4e-99210a0d88ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a59730-3f5c-4980-8c4e-99210a0d88ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c5408d-bdb4-4132-ba47-5e148a97a6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:29 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume e5c26539-b730-4b19-81c4-3152b16b76b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c26539-b730-4b19-81c4-3152b16b76b9', 'volume_size': 1}
Nov 05 12:14:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:30 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55 1073741824" returned: 0 in 0.603s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:30 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55
Nov 05 12:14:30 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:30 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55" returned: 0 in 0.264s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706743476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c26539-b730-4b19-81c4-3152b16b76b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:30Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Creating volume e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:30 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee907ce8-803a-46d0-b0b5-907008a962ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa37480-792c-4e32-a2b3-a90d150f0b55', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12d757-6426-40a2-b55a-899533fe500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:30 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 1073741824
Nov 05 12:14:30 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume volume-8aa37480-792c-4e32-a2b3-a90d150f0b55 (8aa37480-792c-4e32-a2b3-a90d150f0b55): created successfully
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12d757-6426-40a2-b55a-899533fe500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (8943054d-4a1e-46eb-933c-6daad08939c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6b7a9bc4-d6e9-4eb3-ba2e-3e31ea79f678 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created volume successfully.
Nov 05 12:14:31 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 1073741824" returned: 0 in 0.554s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:31 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9
Nov 05 12:14:31 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:31 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9" returned: 0 in 0.271s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c5408d-bdb4-4132-ba47-5e148a97a6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c26539-b730-4b19-81c4-3152b16b76b9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42de7a9d-ba2b-45da-afaa-9d50c1e50ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:31 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume volume-e5c26539-b730-4b19-81c4-3152b16b76b9 (e5c26539-b730-4b19-81c4-3152b16b76b9): created successfully
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42de7a9d-ba2b-45da-afaa-9d50c1e50ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:31 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (87b890fb-20db-4c6e-90c6-70dc8d964f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:31 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d9a1b64b-c23a-454c-a23f-4b4943016a2e tempest-CreateVolumesFromSnapshotTest-950734073 None] Created volume successfully.
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (caca6ce5-9e44-47aa-81d0-849322bc89b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b019be4d-4419-4a17-a52a-9cc02038bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b019be4d-4419-4a17-a52a-9cc02038bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868861601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce724b6-401f-4504-a058-c1b8e9f22886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:32Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4db3ea-8dd5-48a6-b9c4-955fcdabb1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4db3ea-8dd5-48a6-b9c4-955fcdabb1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c362c249-83be-406b-bb5a-7b0ab17c6c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c362c249-83be-406b-bb5a-7b0ab17c6c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce724b6-401f-4504-a058-c1b8e9f22886', 'volume_name': 'volume-7ce724b6-401f-4504-a058-c1b8e9f22886', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653576f-1913-47c8-8591-dd42cec01a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653576f-1913-47c8-8591-dd42cec01a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecade333-a5f3-4007-b942-34065e1c6d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume 7ce724b6-401f-4504-a058-c1b8e9f22886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce724b6-401f-4504-a058-c1b8e9f22886', 'volume_size': 1}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868861601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce724b6-401f-4504-a058-c1b8e9f22886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:32Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Creating volume 7ce724b6-401f-4504-a058-c1b8e9f22886 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:32 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:32 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886 1073741824
Nov 05 12:14:32 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (7e497b14-ed0a-4511-8779-d0fdc0062d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24bf66d-a554-42ca-bc93-4000729cc79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24bf66d-a554-42ca-bc93-4000729cc79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516844134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d86e9ce-f648-46ed-822a-c4b4c1cf5a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:33Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1600c49-206c-4796-a4c8-3e43c386fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1600c49-206c-4796-a4c8-3e43c386fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589ada41-4b90-428f-9097-d67ed013b905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589ada41-4b90-428f-9097-d67ed013b905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d86e9ce-f648-46ed-822a-c4b4c1cf5a32', 'volume_name': 'volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75aadca7-d9ea-44c3-847d-216161cd9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75aadca7-d9ea-44c3-847d-216161cd9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d36df3b-27a9-4265-b904-b69edc64120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:32 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume 0d86e9ce-f648-46ed-822a-c4b4c1cf5a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32', 'volume_size': 1}
Nov 05 12:14:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:33 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886 1073741824" returned: 0 in 0.802s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:33 devstack sudo[105458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886
Nov 05 12:14:33 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (a4d64420-ca27-46a3-9059-8023dbf566ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ddcef-489a-4a87-aa75-bbbb601c0799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ddcef-489a-4a87-aa75-bbbb601c0799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609985536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf28052-f167-43a9-bb11-a5b8817da898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:33Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd9c7a1-4dfb-4cb1-9ded-e667a848b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd9c7a1-4dfb-4cb1-9ded-e667a848b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62cc3c4-aeac-4fce-967c-787c12fcfe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62cc3c4-aeac-4fce-967c-787c12fcfe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf28052-f167-43a9-bb11-a5b8817da898', 'volume_name': 'volume-dbf28052-f167-43a9-bb11-a5b8817da898', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02fcf79-f21d-4150-b128-702d37d7fa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02fcf79-f21d-4150-b128-702d37d7fa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabdd773-6a1f-49f0-9aa8-9c17091f82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:33 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume dbf28052-f167-43a9-bb11-a5b8817da898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf28052-f167-43a9-bb11-a5b8817da898', 'volume_size': 1}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:33 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886" returned: 0 in 0.400s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.087s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Creating offline snapshot c900db13-e673-480b-8b39-d3b443e56074 of volume e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecade333-a5f3-4007-b942-34065e1c6d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce724b6-401f-4504-a058-c1b8e9f22886', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9c23c2-51ee-4f62-99d5-8910a3df2e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5773727-8275-403b-b50d-f6cf60d1872f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:33 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume volume-7ce724b6-401f-4504-a058-c1b8e9f22886 (7ce724b6-401f-4504-a058-c1b8e9f22886): created successfully
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9c23c2-51ee-4f62-99d5-8910a3df2e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (caca6ce5-9e44-47aa-81d0-849322bc89b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-06723b47-f5c7-4c77-b111-ac72730508d6 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created volume successfully.
Nov 05 12:14:33 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9
Nov 05 12:14:33 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:33 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (8d353a1e-a849-4b51-8f7a-9d0ece2f7162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13dbda5-8d0e-4367-bbab-baf78222284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13dbda5-8d0e-4367-bbab-baf78222284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940252629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384dac56-b3a4-47ce-9b36-57b7e5f0a092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:34Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a9167c-996b-4100-b0a3-b13ea6736d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a9167c-996b-4100-b0a3-b13ea6736d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d87ab14-3b8b-4e19-baa0-aa1e53d8d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d87ab14-3b8b-4e19-baa0-aa1e53d8d236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384dac56-b3a4-47ce-9b36-57b7e5f0a092', 'volume_name': 'volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c330080-4e02-488e-8f25-7d5c2fca70b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c330080-4e02-488e-8f25-7d5c2fca70b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1e5029-1db5-407b-9821-9e12eb865d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume 384dac56-b3a4-47ce-9b36-57b7e5f0a092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092', 'volume_size': 1}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:34 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9" returned: 0 in 0.640s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:34 devstack sudo[105466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 1G
Nov 05 12:14:34 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (279e00cf-d067-4751-aca2-ec87e83d717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7c31ca-cd69-4b37-8cf3-ebf08a612657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7c31ca-cd69-4b37-8cf3-ebf08a612657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-471002663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cf3077-093a-418e-a98d-bf7fb9629c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:34Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69124b6-bfcd-4bef-a65f-ed537ee70517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69124b6-bfcd-4bef-a65f-ed537ee70517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6309a192-9d78-484a-9245-2568ed381b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6309a192-9d78-484a-9245-2568ed381b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99cf3077-093a-418e-a98d-bf7fb9629c6d', 'volume_name': 'volume-99cf3077-093a-418e-a98d-bf7fb9629c6d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6056f59-3268-4ed5-95a3-97401cd9bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6056f59-3268-4ed5-95a3-97401cd9bba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5bf50d-564f-4f65-93a5-ee42ef31584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume 99cf3077-093a-418e-a98d-bf7fb9629c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99cf3077-093a-418e-a98d-bf7fb9629c6d', 'volume_size': 1}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:34 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Flow 'volume_create_manager' (cbae788a-d2c8-4651-babe-b2016614ae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1b3ce9-1178-4e4e-a253-f3443d7dc019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 1G" returned: 0 in 0.623s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c26539-b730-4b19-81c4-3152b16b76b9 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:34 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c26539-b730-4b19-81c4-3152b16b76b9 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074
Nov 05 12:14:34 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1b3ce9-1178-4e4e-a253-f3443d7dc019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00928a99-e123-4040-bfde-bff4a24771bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c999af8b0148fbbcabc47c53809c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:35Z,use_quota=True,user_id='ae12c98e652543c7a28152d2b8b0a4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(050bbbf6-5078-49bd-9fa6-2157bc4a46b0),volume_type_id=050bbbf6-5078-49bd-9fa6-2157bc4a46b0)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d95148b-214e-4fc4-baa5-f9a0f9deac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d95148b-214e-4fc4-baa5-f9a0f9deac6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de88367-507f-4f7c-aa23-1a08cab44110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:34 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:14:35 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c26539-b730-4b19-81c4-3152b16b76b9 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074" returned: 0 in 0.319s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:35 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 is being set with open permissions: ugo+rw
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:35 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074
Nov 05 12:14:35 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:35 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074" returned: 0 in 0.253s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de88367-507f-4f7c-aa23-1a08cab44110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00928a99-e123-4040-bfde-bff4a24771bd', 'volume_name': 'volume-00928a99-e123-4040-bfde-bff4a24771bd', 'volume_size': 1, 'image_id': '3219d21e-3456-405a-bcf5-69b61213e083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3219d21e-3456-405a-bcf5-69b61213e083', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c48dadec7d32e74f6038a34db440a15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60c999af8b0148fbbcabc47c53809c30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5f0f7d2800139a1888767f7e1a77aa7a4bccf1c00dcee4e8e9cd1b10c7409b8c17f81d9bb4401dc540bdd5ff417a0fda1dbacbe0e841a96794a69375ce1b6c9', 'id': '3219d21e-3456-405a-bcf5-69b61213e083', 'created_at': datetime.datetime(2026, 11, 5, 11, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3219d21e-3456-405a-bcf5-69b61213e083/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028d2db50>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc6b771-7237-4cb6-9f6f-3cd0ac4f0c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc6b771-7237-4cb6-9f6f-3cd0ac4f0c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea75a25f-662e-434b-9dfa-13dfcecc1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:35 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Volume 00928a99-e123-4040-bfde-bff4a24771bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00928a99-e123-4040-bfde-bff4a24771bd', 'volume_size': 1, 'image_id': '3219d21e-3456-405a-bcf5-69b61213e083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3219d21e-3456-405a-bcf5-69b61213e083', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c48dadec7d32e74f6038a34db440a15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60c999af8b0148fbbcabc47c53809c30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5f0f7d2800139a1888767f7e1a77aa7a4bccf1c00dcee4e8e9cd1b10c7409b8c17f81d9bb4401dc540bdd5ff417a0fda1dbacbe0e841a96794a69375ce1b6c9', 'id': '3219d21e-3456-405a-bcf5-69b61213e083', 'created_at': datetime.datetime(2026, 11, 5, 11, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3219d21e-3456-405a-bcf5-69b61213e083/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028d2db50>}
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Trying to clone 00928a99-e123-4040-bfde-bff4a24771bd from image 3219d21e-3456-405a-bcf5-69b61213e083 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3219d21e-3456-405a-bcf5-69b61213e083', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:35 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.info
Nov 05 12:14:35 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:14:35 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4354f1db-afd6-4e4a-b654-70e1d4b6ce3e]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:35 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD
Nov 05 12:14:35 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:35 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.info" returned: 0 in 0.339s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:35 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.info is being set with open permissions: ugo+rw
Nov 05 12:14:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:35 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.info
Nov 05 12:14:35 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:36 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.info" returned: 0 in 0.311s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516844134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d86e9ce-f648-46ed-822a-c4b4c1cf5a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:33Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Creating volume 0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:36 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:36 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD
Nov 05 12:14:36 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 1073741824
Nov 05 12:14:36 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8efdad3b-dee1-4911-9f20-582a0517bf2d tempest-CreateVolumesFromSnapshotTest-950734073 None] Create snapshot completed successfully
Nov 05 12:14:36 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Temporary image 3219d21e-3456-405a-bcf5-69b61213e083 is fetched for user ae12c98e652543c7a28152d2b8b0a4ae. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db0b44c-a355-4739-88f8-d4cd76437344]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:36 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD
Nov 05 12:14:36 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 1073741824" returned: 0 in 0.566s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:36 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32
Nov 05 12:14:36 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:36 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:37 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.635s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609985536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf28052-f167-43a9-bb11-a5b8817da898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:33Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Creating volume dbf28052-f167-43a9-bb11-a5b8817da898 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:37 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD
Nov 05 12:14:37 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d36df3b-27a9-4265-b904-b69edc64120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:37 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898 1073741824
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0abdc-9b50-425f-bac7-a9deda13e1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:37 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 (0d86e9ce-f648-46ed-822a-c4b4c1cf5a32): created successfully
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0abdc-9b50-425f-bac7-a9deda13e1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (7e497b14-ed0a-4511-8779-d0fdc0062d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-12f41d08-6cd9-48d6-bac0-4f2d6c3d04df tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created volume successfully.
Nov 05 12:14:37 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD" returned: 1 in 0.493s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (c602e08c-bd31-49ed-bf29-a2821e47dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d758256c-6921-4522-b897-aa7a797653f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d758256c-6921-4522-b897-aa7a797653f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133466996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fba7a2-632a-4537-aeac-7224c2134d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:38Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952a62fe-6ee8-463b-a9cf-cfa196e7f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952a62fe-6ee8-463b-a9cf-cfa196e7f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640a5d02-1a03-402d-a35a-9e6440c5525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640a5d02-1a03-402d-a35a-9e6440c5525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47fba7a2-632a-4537-aeac-7224c2134d1e', 'volume_name': 'volume-47fba7a2-632a-4537-aeac-7224c2134d1e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd11f22-2833-4186-83d7-c8a2470283b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd11f22-2833-4186-83d7-c8a2470283b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77366dc2-40a1-4739-a904-e5a89e4c3f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume 47fba7a2-632a-4537-aeac-7224c2134d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47fba7a2-632a-4537-aeac-7224c2134d1e', 'volume_size': 1}
Nov 05 12:14:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:38 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898 1073741824" returned: 0 in 0.906s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:38 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898
Nov 05 12:14:38 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (85cee63c-2530-4364-b848-b43075030697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c5d85c-51cf-4778-aa64-0af5bcea90ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c5d85c-51cf-4778-aa64-0af5bcea90ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1851553916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3665d9-477a-4637-9038-d1969c7c00e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:38Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9140a-2534-478f-b9d9-7dd88ae1e1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9140a-2534-478f-b9d9-7dd88ae1e1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b6fc2f-40d2-48eb-a906-aea5130a9863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b6fc2f-40d2-48eb-a906-aea5130a9863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3665d9-477a-4637-9038-d1969c7c00e7', 'volume_name': 'volume-de3665d9-477a-4637-9038-d1969c7c00e7', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0161418f-c769-46c6-af0b-57554bde3430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0161418f-c769-46c6-af0b-57554bde3430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4b77a5-dbcb-499f-84ab-6429081791ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume de3665d9-477a-4637-9038-d1969c7c00e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3665d9-477a-4637-9038-d1969c7c00e7', 'volume_size': 1}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:38 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898" returned: 0 in 0.351s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.354s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940252629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384dac56-b3a4-47ce-9b36-57b7e5f0a092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:34Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Creating volume 384dac56-b3a4-47ce-9b36-57b7e5f0a092 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:38 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabdd773-6a1f-49f0-9aa8-9c17091f82d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf28052-f167-43a9-bb11-a5b8817da898', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4ff0d0-25c1-4f6e-8cf3-54fb722e54cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092 1073741824
Nov 05 12:14:38 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume volume-dbf28052-f167-43a9-bb11-a5b8817da898 (dbf28052-f167-43a9-bb11-a5b8817da898): created successfully
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4ff0d0-25c1-4f6e-8cf3-54fb722e54cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (a4d64420-ca27-46a3-9059-8023dbf566ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6c7f52ef-52d6-48e7-9983-ff04e6964253 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created volume successfully.
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (1e5e779c-896f-47f1-ab16-21c9d80d39a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b574b48-21e5-496a-857f-60e46e82bb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b574b48-21e5-496a-857f-60e46e82bb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948661395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f511e828-cf09-4752-b7c8-71da0520cbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82424b9f-fb45-4965-9b71-a4a72f3d841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82424b9f-fb45-4965-9b71-a4a72f3d841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7888d3aa-c7ab-4020-b888-093f5aa3af1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7888d3aa-c7ab-4020-b888-093f5aa3af1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f511e828-cf09-4752-b7c8-71da0520cbe4', 'volume_name': 'volume-f511e828-cf09-4752-b7c8-71da0520cbe4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72e3d52-8bb8-4587-acdd-e75febb0b76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72e3d52-8bb8-4587-acdd-e75febb0b76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0cea4c-f9d4-4510-aab5-0468d1137112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume f511e828-cf09-4752-b7c8-71da0520cbe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f511e828-cf09-4752-b7c8-71da0520cbe4', 'volume_size': 1}
Nov 05 12:14:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:39 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092 1073741824" returned: 0 in 0.688s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (ccc2a823-7566-4d37-b9a9-299d220576cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1feb5f5b-d363-4827-9fc9-990370bc5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1feb5f5b-d363-4827-9fc9-990370bc5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198594904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e45128-5862-4e57-9433-dec8398f9f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b6cd9f-04fb-461b-8177-89bf55037a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b6cd9f-04fb-461b-8177-89bf55037a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6e5c5a-ea21-4c8e-9d41-1ad84587552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6e5c5a-ea21-4c8e-9d41-1ad84587552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e45128-5862-4e57-9433-dec8398f9f66', 'volume_name': 'volume-76e45128-5862-4e57-9433-dec8398f9f66', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15291aaa-a3bb-4d47-bdc8-50efe14078c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15291aaa-a3bb-4d47-bdc8-50efe14078c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0b8fdc-b0bd-4525-8c79-124b2b891c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume 76e45128-5862-4e57-9433-dec8398f9f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e45128-5862-4e57-9433-dec8398f9f66', 'volume_size': 1}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:39 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092
Nov 05 12:14:39 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:39 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (1c906531-f1cc-4188-a7d4-5a96b19cf48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43ef38c-9f09-412b-962a-90c1cb33067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092" returned: 0 in 0.409s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-471002663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cf3077-093a-418e-a98d-bf7fb9629c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3708d21cd4964b0eb443afdff7d56f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:34Z,use_quota=True,user_id='bfc54b7dc1374baab1ea042f9ed113ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Creating volume 99cf3077-093a-418e-a98d-bf7fb9629c6d {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:39 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43ef38c-9f09-412b-962a-90c1cb33067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455406175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6edcb80-7998-4f21-bd60-409cd7148bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:40Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d 1073741824
Nov 05 12:14:39 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2087a5-d4c3-465f-accc-b6f5661ab6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2087a5-d4c3-465f-accc-b6f5661ab6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cffccd1-cc0d-4d36-8621-f3ae4110d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cffccd1-cc0d-4d36-8621-f3ae4110d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6edcb80-7998-4f21-bd60-409cd7148bbd', 'volume_name': 'volume-f6edcb80-7998-4f21-bd60-409cd7148bbd', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4768afcd-0fc5-48eb-a15e-a23cc6d6bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4768afcd-0fc5-48eb-a15e-a23cc6d6bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15f4973-1f90-4727-9647-8e62c1e991e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume f6edcb80-7998-4f21-bd60-409cd7148bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6edcb80-7998-4f21-bd60-409cd7148bbd', 'volume_size': 1}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1e5029-1db5-407b-9821-9e12eb865d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cec7e7-da87-42c6-803e-76f7421fcc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:39 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092 (384dac56-b3a4-47ce-9b36-57b7e5f0a092): created successfully
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cec7e7-da87-42c6-803e-76f7421fcc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (8d353a1e-a849-4b51-8f7a-9d0ece2f7162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3a92dcc7-68be-4dbc-afaa-846bf66bd0c7 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created volume successfully.
Nov 05 12:14:40 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d 1073741824" returned: 0 in 0.573s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:40 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d
Nov 05 12:14:40 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:40 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d" returned: 0 in 0.255s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.138s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00928a99-e123-4040-bfde-bff4a24771bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c999af8b0148fbbcabc47c53809c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:35Z,use_quota=True,user_id='ae12c98e652543c7a28152d2b8b0a4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(050bbbf6-5078-49bd-9fa6-2157bc4a46b0),volume_type_id=050bbbf6-5078-49bd-9fa6-2157bc4a46b0)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Creating volume 00928a99-e123-4040-bfde-bff4a24771bd {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:40 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5bf50d-564f-4f65-93a5-ee42ef31584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cf3077-093a-418e-a98d-bf7fb9629c6d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:40 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd 1073741824
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100fc8e0-9126-4f6a-a25a-c19b78935478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:40 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:40 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Volume volume-99cf3077-093a-418e-a98d-bf7fb9629c6d (99cf3077-093a-418e-a98d-bf7fb9629c6d): created successfully
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100fc8e0-9126-4f6a-a25a-c19b78935478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Flow 'volume_create_manager' (279e00cf-d067-4751-aca2-ec87e83d717d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7ff6a0b2-a40c-490c-b356-4083ed8b3333 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created volume successfully.
Nov 05 12:14:41 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd 1073741824" returned: 0 in 0.468s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:41 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd
Nov 05 12:14:41 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:41 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd" returned: 0 in 0.317s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.567s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-133466996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fba7a2-632a-4537-aeac-7224c2134d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:38Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Creating volume 47fba7a2-632a-4537-aeac-7224c2134d1e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:41 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-99cf3077-093a-418e-a98d-bf7fb9629c6d-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:41 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e 1073741824
Nov 05 12:14:41 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-99cf3077-093a-418e-a98d-bf7fb9629c6d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Attempting download of 3219d21e-3456-405a-bcf5-69b61213e083 ((None, [{'url': 'file:///opt/stack/data/glance/images/3219d21e-3456-405a-bcf5-69b61213e083', 'metadata': {}}])) to volume 00928a99-e123-4040-bfde-bff4a24771bd. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-quobyte-99cf3077-093a-418e-a98d-bf7fb9629c6d" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-99cf3077-093a-418e-a98d-bf7fb9629c6d" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cab7c6-21ba-4661-b1bc-77f3824230ac]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3219d21e-3456-405a-bcf5-69b61213e083_cvdg21cl {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[494a1f14-13ea-4963-b3b3-6869b97bdddd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:41 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3219d21e-3456-405a-bcf5-69b61213e083_cvdg21cl
Nov 05 12:14:41 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:41 devstack sudo[105556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d
Nov 05 12:14:41 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e 1073741824" returned: 0 in 0.581s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3219d21e-3456-405a-bcf5-69b61213e083_cvdg21cl" returned: 0 in 0.477s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3219d21e-3456-405a-bcf5-69b61213e083_cvdg21cl {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack sudo[105569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e
Nov 05 12:14:42 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d" returned: 0 in 0.505s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d
Nov 05 12:14:42 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3219d21e-3456-405a-bcf5-69b61213e083_cvdg21cl
Nov 05 12:14:42 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (016f4f70-d2af-4197-ac1f-eae29efeb0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bad157-4f04-4ed9-b938-ca752d835963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29bad157-4f04-4ed9-b938-ca752d835963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565356427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7718927-377b-4f08-bea9-a3fe57c3f769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:42Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924508e9-0ea7-48d0-97f0-b4ef1fb737d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924508e9-0ea7-48d0-97f0-b4ef1fb737d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2558985-d3ef-4c5e-a3c8-ce304dca3666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2558985-d3ef-4c5e-a3c8-ce304dca3666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7718927-377b-4f08-bea9-a3fe57c3f769', 'volume_name': 'volume-f7718927-377b-4f08-bea9-a3fe57c3f769', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d36ce42-a8ca-463f-b3b6-ebd858d185f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d36ce42-a8ca-463f-b3b6-ebd858d185f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5a30f1-c50c-4562-82d3-8df52063ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Volume f7718927-377b-4f08-bea9-a3fe57c3f769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7718927-377b-4f08-bea9-a3fe57c3f769', 'volume_size': 1}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:42 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e" returned: 0 in 0.407s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1851553916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3665d9-477a-4637-9038-d1969c7c00e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:38Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Creating volume de3665d9-477a-4637-9038-d1969c7c00e7 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:42 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:42 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3219d21e-3456-405a-bcf5-69b61213e083_cvdg21cl" returned: 1 in 0.425s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3219d21e-3456-405a-bcf5-69b61213e083_cvdg21cl' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e1531e-3563-482b-bff4-67ccc57b6774]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7 1073741824
Nov 05 12:14:42 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77366dc2-40a1-4739-a904-e5a89e4c3f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47fba7a2-632a-4537-aeac-7224c2134d1e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e27878-cf13-4bd0-a761-64aac114de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-99cf3077-093a-418e-a98d-bf7fb9629c6d" returned: 0 in 0.430s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-99cf3077-093a-418e-a98d-bf7fb9629c6d" released by "delete_volume" :: held 1.000s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume volume-47fba7a2-632a-4537-aeac-7224c2134d1e (47fba7a2-632a-4537-aeac-7224c2134d1e): created successfully
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e27878-cf13-4bd0-a761-64aac114de27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (c602e08c-bd31-49ed-bf29-a2821e47dd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bdfacf08-13ff-4236-bfeb-f6a611c92f91 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created volume successfully.
Nov 05 12:14:42 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD
Nov 05 12:14:42 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created reservations ['bb5b29db-1cfd-48be-bd8f-a904a6563df3', 'ee5a895d-2d3c-4023-bcbc-898d002d94b9', '759a8dda-b132-4ead-90d6-160ee2461379', 'ee230a1c-0cb8-4b97-9ab6-20c994ac8241'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:42 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:42 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:42 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7 1073741824" returned: 0 in 0.522s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7
Nov 05 12:14:43 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.319s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:43 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD
Nov 05 12:14:43 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Deleted volume successfully.
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-86200d42-2340-472a-830c-d66556c9dbfc tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-99cf3077-093a-418e-a98d-bf7fb9629c6d-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:43 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.594s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948661395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f511e828-cf09-4752-b7c8-71da0520cbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Creating volume f511e828-cf09-4752-b7c8-71da0520cbe4 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:43 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] 3219d21e-3456-405a-bcf5-69b61213e083 was raw, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4 1073741824
Nov 05 12:14:43 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4b77a5-dbcb-499f-84ab-6429081791ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3665d9-477a-4637-9038-d1969c7c00e7', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a896802-2cde-4335-88cf-f0ab6ec76e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:43 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd
Nov 05 12:14:43 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:43 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume volume-de3665d9-477a-4637-9038-d1969c7c00e7 (de3665d9-477a-4637-9038-d1969c7c00e7): created successfully
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a896802-2cde-4335-88cf-f0ab6ec76e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (85cee63c-2530-4364-b848-b43075030697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:43 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-875fad4a-52f8-4efd-a7aa-0f1bdd367989 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created volume successfully.
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-384dac56-b3a4-47ce-9b36-57b7e5f0a092-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-384dac56-b3a4-47ce-9b36-57b7e5f0a092-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-quobyte-384dac56-b3a4-47ce-9b36-57b7e5f0a092" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-384dac56-b3a4-47ce-9b36-57b7e5f0a092" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[44666484-ad12-4bab-ad8e-2d9e354bf07b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4 1073741824" returned: 0 in 0.545s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd" returned: 0 in 0.539s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3219d21e-3456-405a-bcf5-69b61213e083_0ps8z6fpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:14:43 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:43 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd 1G
Nov 05 12:14:43 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092
Nov 05 12:14:44 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4
Nov 05 12:14:44 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.998s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198594904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e45128-5862-4e57-9433-dec8398f9f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:39Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Creating volume 76e45128-5862-4e57-9433-dec8398f9f66 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:44 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0cea4c-f9d4-4510-aab5-0468d1137112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f511e828-cf09-4752-b7c8-71da0520cbe4', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66 1073741824
Nov 05 12:14:44 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb1467e-ed45-4073-989e-2177c25327b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:44 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume volume-f511e828-cf09-4752-b7c8-71da0520cbe4 (f511e828-cf09-4752-b7c8-71da0520cbe4): created successfully
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb1467e-ed45-4073-989e-2177c25327b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (1e5e779c-896f-47f1-ab16-21c9d80d39a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c204e94c-6d5f-4add-a509-377101b81305 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created volume successfully.
Nov 05 12:14:44 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092" returned: 0 in 0.519s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:44 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd 1G" returned: 0 in 0.472s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Downloaded image 3219d21e-3456-405a-bcf5-69b61213e083 ((None, [{'url': 'file:///opt/stack/data/glance/images/3219d21e-3456-405a-bcf5-69b61213e083', 'metadata': {}}])) to volume 00928a99-e123-4040-bfde-bff4a24771bd successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Temporary image 3219d21e-3456-405a-bcf5-69b61213e083 for user ae12c98e652543c7a28152d2b8b0a4ae is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Marking volume 00928a99-e123-4040-bfde-bff4a24771bd as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:14:44 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Copying metadata from image 3219d21e-3456-405a-bcf5-69b61213e083 to 00928a99-e123-4040-bfde-bff4a24771bd. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Creating volume glance metadata for volume 00928a99-e123-4040-bfde-bff4a24771bd backed by image 3219d21e-3456-405a-bcf5-69b61213e083 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3219d21e-3456-405a-bcf5-69b61213e083', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3c48dadec7d32e74f6038a34db440a15', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:14:44 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea75a25f-662e-434b-9dfa-13dfcecc1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00928a99-e123-4040-bfde-bff4a24771bd', 'volume_size': 1, 'image_id': '3219d21e-3456-405a-bcf5-69b61213e083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3219d21e-3456-405a-bcf5-69b61213e083', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c48dadec7d32e74f6038a34db440a15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60c999af8b0148fbbcabc47c53809c30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5f0f7d2800139a1888767f7e1a77aa7a4bccf1c00dcee4e8e9cd1b10c7409b8c17f81d9bb4401dc540bdd5ff417a0fda1dbacbe0e841a96794a69375ce1b6c9', 'id': '3219d21e-3456-405a-bcf5-69b61213e083', 'created_at': datetime.datetime(2026, 11, 5, 11, 14, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3219d21e-3456-405a-bcf5-69b61213e083/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028d2db50>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45ef11d-3212-45b1-b551-c0a571a82402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:44 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Volume volume-00928a99-e123-4040-bfde-bff4a24771bd (00928a99-e123-4040-bfde-bff4a24771bd): created successfully
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45ef11d-3212-45b1-b551-c0a571a82402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Flow 'volume_create_manager' (cbae788a-d2c8-4651-babe-b2016614ae48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d7fa34a2-4c8e-4250-a2fd-57646d74dabe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Created volume successfully.
Nov 05 12:14:44 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-384dac56-b3a4-47ce-9b36-57b7e5f0a092" returned: 0 in 0.299s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-384dac56-b3a4-47ce-9b36-57b7e5f0a092" released by "delete_volume" :: held 0.876s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created reservations ['e09f8eec-fbfa-4bb2-ab5a-586ffcbe3fcb', 'd806cd09-3399-4a20-941d-9fc0234e9ee5', '2363f8c8-7f15-4347-a6b9-e744c05436cb', 'c40e1bc0-7224-4856-8a92-98bf26e2bb97'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:44 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66 1073741824" returned: 0 in 0.519s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:44 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:44 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66
Nov 05 12:14:44 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-dbf28052-f167-43a9-bb11-a5b8817da898-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-dbf28052-f167-43a9-bb11-a5b8817da898-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-quobyte-dbf28052-f167-43a9-bb11-a5b8817da898" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-dbf28052-f167-43a9-bb11-a5b8817da898" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:45 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.323s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fece67fe-6247-4e3c-8012-b01a3f0625bc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Deleted volume successfully.
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-76df0ac4-0e12-46e6-be48-8fac6c54e834 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-384dac56-b3a4-47ce-9b36-57b7e5f0a092-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:45 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66" returned: 0 in 0.389s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.469s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455406175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6edcb80-7998-4f21-bd60-409cd7148bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c06a67f4be4dd891e893eb4a98feac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:40Z,use_quota=True,user_id='e332a530f1b3401b99850e8e70bd9ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Creating volume f6edcb80-7998-4f21-bd60-409cd7148bbd {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:45 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0b8fdc-b0bd-4525-8c79-124b2b891c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e45128-5862-4e57-9433-dec8398f9f66', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:45 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd 1073741824
Nov 05 12:14:45 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc9188c-40a6-4374-beda-6c9e871cdc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:45 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898
Nov 05 12:14:45 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume volume-76e45128-5862-4e57-9433-dec8398f9f66 (76e45128-5862-4e57-9433-dec8398f9f66): created successfully
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc9188c-40a6-4374-beda-6c9e871cdc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (ccc2a823-7566-4d37-b9a9-299d220576cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e1919be8-f4c2-483c-b315-1c8df6e1f41a tempest-CreateVolumesFromSnapshotTest-950734073 None] Created volume successfully.
Nov 05 12:14:45 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898" returned: 0 in 0.439s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Acquiring lock "cinder-00928a99-e123-4040-bfde-bff4a24771bd-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:45 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898
Nov 05 12:14:45 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "cinder-00928a99-e123-4040-bfde-bff4a24771bd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Acquiring lock "cinder-quobyte-00928a99-e123-4040-bfde-bff4a24771bd" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "cinder-quobyte-00928a99-e123-4040-bfde-bff4a24771bd" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dede2f-0c07-4682-8b40-fdcd4382dff1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd 1073741824" returned: 0 in 0.556s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:45 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd
Nov 05 12:14:45 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd
Nov 05 12:14:45 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:45 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-dbf28052-f167-43a9-bb11-a5b8817da898" returned: 0 in 0.327s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-dbf28052-f167-43a9-bb11-a5b8817da898" released by "delete_volume" :: held 0.833s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created reservations ['14a8718e-dedc-4c9a-a55d-3ecd791be639', '0b7e21f2-724f-4460-bcf2-372a186f9ea5', '377f6731-508c-4934-be78-d231ff465a4f', '43e33b6c-973d-4630-848e-89c707638d17'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:46 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd" returned: 0 in 0.308s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.756s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565356427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7718927-377b-4f08-bea9-a3fe57c3f769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:42Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Creating volume f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:46 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:46 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd" returned: 0 in 0.485s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd
Nov 05 12:14:46 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15f4973-1f90-4727-9647-8e62c1e991e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6edcb80-7998-4f21-bd60-409cd7148bbd', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:46 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 1073741824
Nov 05 12:14:46 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f93072-2037-4b4b-8d67-1ee430eb661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:46 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Volume volume-f6edcb80-7998-4f21-bd60-409cd7148bbd (f6edcb80-7998-4f21-bd60-409cd7148bbd): created successfully
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f93072-2037-4b4b-8d67-1ee430eb661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Flow 'volume_create_manager' (1c906531-f1cc-4188-a7d4-5a96b19cf48a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5a738326-20c8-4f69-9da7-1ef95b844690 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created volume successfully.
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-quobyte-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d653969c-1507-4f4f-86cf-f28b17728d95]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.428s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-f6edcb80-7998-4f21-bd60-409cd7148bbd-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Deleted volume successfully.
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-f6edcb80-7998-4f21-bd60-409cd7148bbd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f958ddde-44bf-4403-9473-62874e36127d tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-dbf28052-f167-43a9-bb11-a5b8817da898-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-f6edcb80-7998-4f21-bd60-409cd7148bbd" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:46 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-00928a99-e123-4040-bfde-bff4a24771bd" returned: 0 in 0.412s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-f6edcb80-7998-4f21-bd60-409cd7148bbd" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "cinder-quobyte-00928a99-e123-4040-bfde-bff4a24771bd" released by "delete_volume" :: held 0.966s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:46 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32
Nov 05 12:14:46 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e4f0d-55d4-4130-bb93-3994aa07ec90]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:46 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd
Nov 05 12:14:46 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Created reservations ['3dd94f99-2ac5-4676-b49d-9c79331ec7ff', '5fef283b-91b6-4f12-bb8c-fad609d79144', '2687526b-a374-4b24-85c5-f826e9ab189a', '4e67ca40-22c3-4094-8b4b-4e8326b982c4'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:46 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 1073741824" returned: 0 in 0.728s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:47 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32" returned: 0 in 0.534s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[105685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769
Nov 05 12:14:47 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32
Nov 05 12:14:47 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd" returned: 0 in 0.490s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[105693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd
Nov 05 12:14:47 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.306s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Deleted volume successfully.
Nov 05 12:14:47 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-169da082-38a9-4a45-81ce-bcc8a1577afe tempest-VolumeAndVolumeTypeFromImageTest-118227832 None] Lock "cinder-00928a99-e123-4040-bfde-bff4a24771bd-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:47 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32" returned: 0 in 0.299s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32" released by "delete_volume" :: held 0.901s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5a30f1-c50c-4562-82d3-8df52063ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7718927-377b-4f08-bea9-a3fe57c3f769', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ef16a2-21e8-40c9-afde-0b767ae85401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:47 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Volume volume-f7718927-377b-4f08-bea9-a3fe57c3f769 (f7718927-377b-4f08-bea9-a3fe57c3f769): created successfully
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ef16a2-21e8-40c9-afde-0b767ae85401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (016f4f70-d2af-4197-ac1f-eae29efeb0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7416308f-b8c6-48f6-8cef-d9bc047f2bfe tempest-ProjectReaderTests-1185429902 None] Created volume successfully.
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created reservations ['540529f0-3852-447d-bc71-7d855e1bed19', '92415a5c-34e8-41a2-a8ef-fce9b95d1907', '40e4e350-8d6a-4430-9d04-8b389e4212a8', '6f964797-5fdc-4f35-8400-9893766a11fd'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f6edcb80-7998-4f21-bd60-409cd7148bbd" returned: 0 in 0.327s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack sudo[105699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:47 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-f6edcb80-7998-4f21-bd60-409cd7148bbd" released by "delete_volume" :: held 0.876s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Created reservations ['3a3f4f1b-9f22-4e62-b2ee-fb86db43df0c', '6ff98138-bad2-4326-b793-c45c02b7ae9d', 'ce889ba9-bfb1-4514-97cb-6509f209afad', 'b96865a0-5780-4804-bc8d-32711269513c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:47 devstack sudo[105701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:47 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-76e45128-5862-4e57-9433-dec8398f9f66-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-76e45128-5862-4e57-9433-dec8398f9f66-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:47 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.355s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Deleted volume successfully.
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-4347200c-e84c-49d1-84bc-d1656c1e1d9c tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-0d86e9ce-f648-46ed-822a-c4b4c1cf5a32-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-76e45128-5862-4e57-9433-dec8398f9f66" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-76e45128-5862-4e57-9433-dec8398f9f66" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56dfe9d-e389-4b2d-a11a-e9152a4f85e2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66
Nov 05 12:14:48 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.433s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:48 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Deleted volume successfully.
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1e6d2f3c-0a11-40d9-80fc-c4cf11609bfe tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-f6edcb80-7998-4f21-bd60-409cd7148bbd-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Creating offline snapshot ba70a4b2-2297-4560-8ede-7e1030f8887d of volume f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[de88eaa7-75f6-4d41-9552-ae672f5dc628]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66" returned: 0 in 0.511s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-7ce724b6-401f-4504-a058-c1b8e9f22886-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:48 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66
Nov 05 12:14:48 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-7ce724b6-401f-4504-a058-c1b8e9f22886-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-quobyte-7ce724b6-401f-4504-a058-c1b8e9f22886" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:48 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769
Nov 05 12:14:48 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-7ce724b6-401f-4504-a058-c1b8e9f22886" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a96b0b-fb24-4408-9eaf-a0d111a5e331]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:48 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886
Nov 05 12:14:48 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:48 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-76e45128-5862-4e57-9433-dec8398f9f66" returned: 0 in 0.393s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-76e45128-5862-4e57-9433-dec8398f9f66" released by "delete_volume" :: held 0.976s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:48 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769" returned: 0 in 0.489s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:49 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d 1G
Nov 05 12:14:49 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created reservations ['29f93a87-6c6d-4e17-b1a2-a09ac9aeb3c6', '6b710e5a-c77d-47b8-869a-6ec94d602a58', 'aed95cfb-8cd7-4d41-b8d9-90ec600451d2', 'd2878ebe-2224-45f3-82ea-2602c839706c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:49 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886" returned: 0 in 0.519s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:49 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:49 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:49 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886
Nov 05 12:14:49 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:49 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:49 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d 1G" returned: 0 in 0.601s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7718927-377b-4f08-bea9-a3fe57c3f769 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7ce724b6-401f-4504-a058-c1b8e9f22886" returned: 0 in 0.347s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:49 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:49 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7718927-377b-4f08-bea9-a3fe57c3f769 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d
Nov 05 12:14:49 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.390s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-7ce724b6-401f-4504-a058-c1b8e9f22886" released by "delete_volume" :: held 0.947s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Deleted volume successfully.
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc3f22d5-ef4b-4c4e-ae6d-b85602c363a6 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-76e45128-5862-4e57-9433-dec8398f9f66-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created reservations ['4e99ff10-865d-4833-9478-42482e4750c7', '492d8c0b-10b3-4bbb-bac2-55e373f3bb36', '461ceba7-a61a-4a93-be4a-d5069b9dbf36', 'ad30bbbc-14ec-482e-b192-bc4a39fe4be9'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:49 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:49 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-8aa37480-792c-4e32-a2b3-a90d150f0b55-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-8aa37480-792c-4e32-a2b3-a90d150f0b55-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "cinder-quobyte-8aa37480-792c-4e32-a2b3-a90d150f0b55" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-8aa37480-792c-4e32-a2b3-a90d150f0b55" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f2ea1-f263-4e16-a050-07d92cae878d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:50 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7718927-377b-4f08-bea9-a3fe57c3f769 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d" returned: 0 in 0.477s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d is being set with open permissions: ugo+rw
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d
Nov 05 12:14:50 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-f511e828-cf09-4752-b7c8-71da0520cbe4-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:50 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55
Nov 05 12:14:50 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-f511e828-cf09-4752-b7c8-71da0520cbe4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-f511e828-cf09-4752-b7c8-71da0520cbe4" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-f511e828-cf09-4752-b7c8-71da0520cbe4" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:50 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.548s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:50 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Deleted volume successfully.
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b34d3eb-0935-49cc-a7b1-bed68182dc05]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3c0d00e1-dc6d-4a60-9f54-debdbe916ec3 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-7ce724b6-401f-4504-a058-c1b8e9f22886-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:50 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d" returned: 0 in 0.476s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4
Nov 05 12:14:50 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.info
Nov 05 12:14:50 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55" returned: 0 in 0.585s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55
Nov 05 12:14:50 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4" returned: 0 in 0.489s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4
Nov 05 12:14:50 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:50 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.info" returned: 0 in 0.396s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:50 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.info is being set with open permissions: ugo+rw
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:50 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aa37480-792c-4e32-a2b3-a90d150f0b55" returned: 0 in 0.359s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.info
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-quobyte-8aa37480-792c-4e32-a2b3-a90d150f0b55" released by "delete_volume" :: held 1.013s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:51 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Created reservations ['1c7c526c-b38e-468d-bc46-30d0d52c2747', 'bb2eee18-858e-4e90-aff1-58588de56f3a', 'f4658966-9c2a-42a2-9466-32933f05c692', '5e9462dc-184d-4f69-9c57-1c2afab80ce7'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f511e828-cf09-4752-b7c8-71da0520cbe4" returned: 0 in 0.343s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:51 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-f511e828-cf09-4752-b7c8-71da0520cbe4" released by "delete_volume" :: held 0.929s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:51 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.info" returned: 0 in 0.322s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created reservations ['9a2e1677-61ea-48ce-9557-8766c9e5ce74', '16d39263-ce2a-4db2-90e1-0a6e662d2ddb', '8eea705d-226d-4a05-9e00-fc3e4931ab1b', '2c3ad79d-f19a-4f6c-afde-d0c9daa2a830'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3df5440d-1b83-4d36-8bd8-1121e785447a tempest-ProjectReaderTests-1185429902 None] Create snapshot completed successfully
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:51 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:51 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-de3665d9-477a-4637-9038-d1969c7c00e7-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.348s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-de3665d9-477a-4637-9038-d1969c7c00e7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Deleted volume successfully.
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-39f233dd-fd91-4d0b-886c-c75cbae6fe26 tempest-CreateVolumesFromSourceVolumeTest-1045024331 None] Lock "cinder-8aa37480-792c-4e32-a2b3-a90d150f0b55-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-de3665d9-477a-4637-9038-d1969c7c00e7" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-de3665d9-477a-4637-9038-d1969c7c00e7" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdea74a-5cd4-4054-8482-0e8dacc0bca1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:51 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.336s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Deleted volume successfully.
Nov 05 12:14:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-cf496be5-ac7f-477e-b04a-d43877e2e110 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-f511e828-cf09-4752-b7c8-71da0520cbe4-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:51 devstack sudo[105776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7
Nov 05 12:14:51 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-ba70a4b2-2297-4560-8ede-7e1030f8887d-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-ba70a4b2-2297-4560-8ede-7e1030f8887d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-f7718927-377b-4f08-bea9-a3fe57c3f769" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-f7718927-377b-4f08-bea9-a3fe57c3f769" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-ba70a4b2-2297-4560-8ede-7e1030f8887d" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-ba70a4b2-2297-4560-8ede-7e1030f8887d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Deleting offline snapshot ba70a4b2-2297-4560-8ede-7e1030f8887d of volume f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] snapshot_file for this snap is: volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:52 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7" returned: 0 in 0.484s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c489af-59e1-4b43-b7c0-4744a6eda92c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:52 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7
Nov 05 12:14:52 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d
Nov 05 12:14:52 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-de3665d9-477a-4637-9038-d1969c7c00e7" returned: 0 in 0.333s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-de3665d9-477a-4637-9038-d1969c7c00e7" released by "delete_volume" :: held 0.889s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created reservations ['82d28dfd-68e7-4ad8-a611-5359e9933791', 'c6c794d3-a26f-4fbf-bb4c-932d7de89931', 'adc87d5a-2380-4780-b960-598ea512247e', '434c3515-64fa-406b-9073-936a793a46f3'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:52 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d" returned: 0 in 0.516s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7718927-377b-4f08-bea9-a3fe57c3f769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:52 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:52 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20f5b3-c898-4162-a0e4-1ceb6c16bfe4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-47fba7a2-632a-4537-aeac-7224c2134d1e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-47fba7a2-632a-4537-aeac-7224c2134d1e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-47fba7a2-632a-4537-aeac-7224c2134d1e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-47fba7a2-632a-4537-aeac-7224c2134d1e" acquired by "delete_volume" :: waited 0.029s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6766231-69a8-4ab8-abfe-c8ef6ef00c3e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:53 devstack sudo[105791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769
Nov 05 12:14:53 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:53 devstack sudo[105792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e
Nov 05 12:14:53 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:53 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.488s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:53 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Deleted volume successfully.
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-701a5298-8eb9-40f9-a0b2-495343dd3765 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-de3665d9-477a-4637-9038-d1969c7c00e7-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:53 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769" returned: 0 in 0.598s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:53 devstack sudo[105799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d
Nov 05 12:14:53 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:53 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e" returned: 0 in 0.548s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:53 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e
Nov 05 12:14:53 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:53 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d" returned: 0 in 0.478s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:53 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-47fba7a2-632a-4537-aeac-7224c2134d1e" returned: 0 in 0.354s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:53 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d
Nov 05 12:14:53 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-47fba7a2-632a-4537-aeac-7224c2134d1e" released by "delete_volume" :: held 0.982s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created reservations ['86ee867d-b848-4097-86f1-027acde31e75', '5ed77166-9841-4bf4-83dc-fc666c204af8', 'd05fbbd2-0afc-45ea-befd-81145bbaa411', 'e31480ef-0a4e-46d6-9763-504e9517131c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:54 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:54 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:54 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769.ba70a4b2-2297-4560-8ede-7e1030f8887d" returned: 0 in 0.299s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-ba70a4b2-2297-4560-8ede-7e1030f8887d" released by "_delete_snapshot" :: held 2.102s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-f7718927-377b-4f08-bea9-a3fe57c3f769" released by "delete_snapshot" :: held 2.137s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Created reservations ['a34bd4e6-1ac2-4ced-989e-d6cf1ee82c87', 'c395d9b4-9bfb-4508-a78d-9ae3efdbaff9', '35094970-665c-481d-aaa5-61308136f87e', '9fbe7691-6659-4361-995f-691b0cad7b42'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Delete snapshot completed successfully.
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ac7cddf1-908b-455d-a5c6-d646a2da79b9 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-ba70a4b2-2297-4560-8ede-7e1030f8887d-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:54 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.366s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Deleted volume successfully.
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8852181-b264-4488-91de-211f8b5358e0 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-47fba7a2-632a-4537-aeac-7224c2134d1e-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (22aad788-3004-4517-af03-f77e28e81f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae38ec19-7b72-4660-9a6a-8d2b54a39f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae38ec19-7b72-4660-9a6a-8d2b54a39f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1184147361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f4aad9-a028-4f7c-bcf4-695e890f2979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:55Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61d9820-a7b6-4191-9f86-94d4d1915b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61d9820-a7b6-4191-9f86-94d4d1915b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaed9d19-f8e3-4ce6-92d1-f6bcab1cb7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaed9d19-f8e3-4ce6-92d1-f6bcab1cb7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f4aad9-a028-4f7c-bcf4-695e890f2979', 'volume_name': 'volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40425541-5203-444b-bf4f-872240773767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40425541-5203-444b-bf4f-872240773767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fadb1c-6575-4220-a50e-0e8a5ecd6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:54 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Volume c3f4aad9-a028-4f7c-bcf4-695e890f2979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979', 'volume_size': 1}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1184147361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f4aad9-a028-4f7c-bcf4-695e890f2979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:55Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Creating volume c3f4aad9-a028-4f7c-bcf4-695e890f2979 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:54 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:54 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979 1073741824
Nov 05 12:14:54 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-c900db13-e673-480b-8b39-d3b443e56074-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-c900db13-e673-480b-8b39-d3b443e56074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-e5c26539-b730-4b19-81c4-3152b16b76b9" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-e5c26539-b730-4b19-81c4-3152b16b76b9" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-c900db13-e673-480b-8b39-d3b443e56074" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-c900db13-e673-480b-8b39-d3b443e56074" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Deleting offline snapshot c900db13-e673-480b-8b39-d3b443e56074 of volume e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] snapshot_file for this snap is: volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c245a1a-8c24-404a-9e2b-07e7b2786307]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (118e8535-f2be-4d72-ad6e-63c3501a9e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434ed3f5-6289-435b-8a86-122bf784f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-f7718927-377b-4f08-bea9-a3fe57c3f769-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:55 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074
Nov 05 12:14:55 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434ed3f5-6289-435b-8a86-122bf784f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-928073647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3c5716-2c28-4576-a2a0-f097bd88c7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:55Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc1ce86-d8d3-4887-a2ef-7a4cafd1336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc1ce86-d8d3-4887-a2ef-7a4cafd1336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55425ca2-18fe-482e-a68a-38974c3ad4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:55 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55425ca2-18fe-482e-a68a-38974c3ad4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3c5716-2c28-4576-a2a0-f097bd88c7bb', 'volume_name': 'volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83aaa962-0d3d-4f0c-850b-14377c3d8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83aaa962-0d3d-4f0c-850b-14377c3d8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7877a28f-3d96-47db-b33e-59e799a9bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:55 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Volume ff3c5716-2c28-4576-a2a0-f097bd88c7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb', 'volume_size': 1}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979 1073741824" returned: 0 in 0.633s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-f7718927-377b-4f08-bea9-a3fe57c3f769-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-f7718927-377b-4f08-bea9-a3fe57c3f769" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:55 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979
Nov 05 12:14:55 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-f7718927-377b-4f08-bea9-a3fe57c3f769" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[2255ed13-9286-4ad3-a961-cca309a79c7e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:55 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074" returned: 0 in 0.654s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c26539-b730-4b19-81c4-3152b16b76b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:14:55 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769
Nov 05 12:14:55 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3062c8-b7a1-423d-aeb7-81a649faa310]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979" returned: 0 in 0.498s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-928073647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3c5716-2c28-4576-a2a0-f097bd88c7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:55Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Creating volume ff3c5716-2c28-4576-a2a0-f097bd88c7bb {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:56 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fadb1c-6575-4220-a50e-0e8a5ecd6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack sudo[105836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb 1073741824
Nov 05 12:14:56 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbc944b-93da-472a-af63-6beea3753ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (0dc6c6df-d29d-46d5-9659-b12432d9f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8087ade8-8542-4805-b51e-e65713ef861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Volume volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979 (c3f4aad9-a028-4f7c-bcf4-695e890f2979): created successfully
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbc944b-93da-472a-af63-6beea3753ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (22aad788-3004-4517-af03-f77e28e81f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8087ade8-8542-4805-b51e-e65713ef861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641954529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92803b3a-99d6-496b-98f1-28ff4d25bfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:56Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb35dda1-6026-4ecb-ba44-3c19c554aa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb35dda1-6026-4ecb-ba44-3c19c554aa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9
Nov 05 12:14:56 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a65127-69b5-4fdd-a3f1-2187e7b0084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a65127-69b5-4fdd-a3f1-2187e7b0084e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92803b3a-99d6-496b-98f1-28ff4d25bfa8', 'volume_name': 'volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c6f32-2a60-42fd-923b-09a49aef6fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c6f32-2a60-42fd-923b-09a49aef6fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fd97f2-6007-46eb-9bb1-c0ae0f2de9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Volume 92803b3a-99d6-496b-98f1-28ff4d25bfa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8', 'volume_size': 1}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-643fd344-c285-4b40-9f3a-c4797a3c7950 tempest-CreateVolumesFromImageTest-294184903 None] Created volume successfully.
Nov 05 12:14:56 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769" returned: 0 in 0.798s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769
Nov 05 12:14:56 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (ab8b3236-d2f6-4605-8373-98877dbdff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6bc5f6-b267-4f23-aa60-65267e798f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6bc5f6-b267-4f23-aa60-65267e798f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455340701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e9cb80-01fb-413a-85c5-4f6ce22ca883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab7cdfb-566f-46cc-984e-7c0a47ca2536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab7cdfb-566f-46cc-984e-7c0a47ca2536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16510843-3506-4d16-ad7e-470bf3d6f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16510843-3506-4d16-ad7e-470bf3d6f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e9cb80-01fb-413a-85c5-4f6ce22ca883', 'volume_name': 'volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa0e459-19cf-4e2d-b121-29b15f820064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa0e459-19cf-4e2d-b121-29b15f820064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4869540-a6fe-488a-b403-316a22e6dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Volume f4e9cb80-01fb-413a-85c5-4f6ce22ca883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883', 'volume_size': 1}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:56 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9" returned: 0 in 0.838s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:56 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074
Nov 05 12:14:56 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:57 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f7718927-377b-4f08-bea9-a3fe57c3f769" returned: 0 in 0.452s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb 1073741824" returned: 0 in 0.904s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Flow 'volume_create_manager' (9cac79f4-c911-4f75-ba06-96aebf78c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3118765c-b136-488b-9201-1a4ba54c4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-f7718927-377b-4f08-bea9-a3fe57c3f769" released by "delete_volume" :: held 1.449s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3118765c-b136-488b-9201-1a4ba54c4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1614525113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af993580-1726-47b2-bfc9-087720b89498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d889baeec7e0466f82df734984fcdae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='591695d781de4cf992a522c134a64436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037d5312-9583-401f-9ac2-d62573d66eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037d5312-9583-401f-9ac2-d62573d66eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d752b4-0028-41d7-b203-4448e1196ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d752b4-0028-41d7-b203-4448e1196ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af993580-1726-47b2-bfc9-087720b89498', 'volume_name': 'volume-af993580-1726-47b2-bfc9-087720b89498', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84306953-3cf1-4f7f-82ab-0cb2567caf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84306953-3cf1-4f7f-82ab-0cb2567caf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b634a0bf-a87d-4b26-8cb6-1ecddca08c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Volume af993580-1726-47b2-bfc9-087720b89498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af993580-1726-47b2-bfc9-087720b89498', 'volume_size': 1}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:57 devstack sudo[105855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb
Nov 05 12:14:57 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Created reservations ['a4d2244a-0032-4c46-ad0e-ffc8b5ca9051', 'a287033d-1766-401c-a560-613d825b5261', '7cf815db-f0a6-4b7b-8eca-4dc6784f6d62', '95e2a6cf-5c06-433e-af87-4e6574c4e5fa'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (62186182-a54a-44d5-85bd-f72d4e3caec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651bff33-4159-4d87-a55c-15d147e3b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651bff33-4159-4d87-a55c-15d147e3b454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059602016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197c8837-1ca3-49cc-b697-d81defc4e1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8bb9f8-afcc-4bbf-ac06-bfa9fcd2c310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8bb9f8-afcc-4bbf-ac06-bfa9fcd2c310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db8480e-7d44-4f6d-b33d-0fd36d261f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db8480e-7d44-4f6d-b33d-0fd36d261f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197c8837-1ca3-49cc-b697-d81defc4e1d9', 'volume_name': 'volume-197c8837-1ca3-49cc-b697-d81defc4e1d9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be710338-49f2-4eea-9e5a-85e26c34204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be710338-49f2-4eea-9e5a-85e26c34204b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea4fcb1-04ce-4f07-bf42-3652edfb7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Volume 197c8837-1ca3-49cc-b697-d81defc4e1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197c8837-1ca3-49cc-b697-d81defc4e1d9', 'volume_size': 1}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074" returned: 0 in 0.498s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:57 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074
Nov 05 12:14:57 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:57 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb" returned: 0 in 0.299s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:57 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:57 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641954529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92803b3a-99d6-496b-98f1-28ff4d25bfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:56Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Creating volume 92803b3a-99d6-496b-98f1-28ff4d25bfa8 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:57 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7877a28f-3d96-47db-b33e-59e799a9bafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2889869-4f84-498d-abc0-c2c17e0a1e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:57 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8 1073741824
Nov 05 12:14:57 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Volume volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb (ff3c5716-2c28-4576-a2a0-f097bd88c7bb): created successfully
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2889869-4f84-498d-abc0-c2c17e0a1e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (118e8535-f2be-4d72-ad6e-63c3501a9e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a497a5bb-122b-4f89-a82f-73b967d20b5a tempest-CreateVolumesFromImageTest-294184903 None] Created volume successfully.
Nov 05 12:14:57 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9.c900db13-e673-480b-8b39-d3b443e56074" returned: 0 in 0.318s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.310s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Deleted volume successfully.
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-c900db13-e673-480b-8b39-d3b443e56074" released by "_delete_snapshot" :: held 2.505s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-e5c26539-b730-4b19-81c4-3152b16b76b9" released by "delete_snapshot" :: held 2.559s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6d344558-ab9b-40f0-83cc-444c375743a0 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-f7718927-377b-4f08-bea9-a3fe57c3f769-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created reservations ['b2e25a8c-da3c-48a6-b802-3043f54cd159', 'b501ab11-ddf5-47b3-9c3a-970ee9fd716b', '66c55c3c-2db0-449b-9587-d84610802e02', '3a8552a5-b1b3-4590-9965-edd5bcb5ee12'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Delete snapshot completed successfully.
Nov 05 12:14:57 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-1c422d89-dda3-40be-b682-62e9ecfdfea7 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-c900db13-e673-480b-8b39-d3b443e56074-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:58 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8 1073741824" returned: 0 in 0.525s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:58 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8
Nov 05 12:14:58 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:58 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455340701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e9cb80-01fb-413a-85c5-4f6ce22ca883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Creating volume f4e9cb80-01fb-413a-85c5-4f6ce22ca883 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:58 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fd97f2-6007-46eb-9bb1-c0ae0f2de9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4981a554-d385-45ee-a2be-d9c1f1783776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:58 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883 1073741824
Nov 05 12:14:58 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Volume volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8 (92803b3a-99d6-496b-98f1-28ff4d25bfa8): created successfully
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4981a554-d385-45ee-a2be-d9c1f1783776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (0dc6c6df-d29d-46d5-9659-b12432d9f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-e5c26539-b730-4b19-81c4-3152b16b76b9-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:58 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-fdfc0f31-2fc9-4db3-9159-a47275a842be tempest-CreateVolumesFromImageTest-294184903 None] Created volume successfully.
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-e5c26539-b730-4b19-81c4-3152b16b76b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "cinder-quobyte-e5c26539-b730-4b19-81c4-3152b16b76b9" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-e5c26539-b730-4b19-81c4-3152b16b76b9" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (427bddff-b8ef-49d2-a960-6072d138c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf14178d-928b-42a1-b1ac-be105b683d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[659fc1e5-81cc-4940-940b-5d38b0efb8d1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf14178d-928b-42a1-b1ac-be105b683d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714735116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dca9b64-cb03-45de-8f3d-a5cb9710e263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:58Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3a68fd-8e26-4856-8001-9f122870403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3a68fd-8e26-4856-8001-9f122870403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a3a91f-5028-4fc3-bec2-9d34720f9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a3a91f-5028-4fc3-bec2-9d34720f9131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dca9b64-cb03-45de-8f3d-a5cb9710e263', 'volume_name': 'volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd456ba9-1132-4a6f-b316-bba290b9267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd456ba9-1132-4a6f-b316-bba290b9267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bff1a7-6e34-432c-b383-7d3033765fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:58 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Volume 1dca9b64-cb03-45de-8f3d-a5cb9710e263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263', 'volume_size': 1}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:58 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9
Nov 05 12:14:58 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:58 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883 1073741824" returned: 0 in 0.515s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:58 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883
Nov 05 12:14:58 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:59 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9" returned: 0 in 0.402s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:59 devstack sudo[105895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9
Nov 05 12:14:59 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:59 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883" returned: 0 in 0.263s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1614525113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af993580-1726-47b2-bfc9-087720b89498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d889baeec7e0466f82df734984fcdae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='591695d781de4cf992a522c134a64436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Creating volume af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:14:59 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4869540-a6fe-488a-b403-316a22e6dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:59 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 1073741824
Nov 05 12:14:59 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a131691d-1d91-43cf-8c20-8738c923441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:14:59 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Volume volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883 (f4e9cb80-01fb-413a-85c5-4f6ce22ca883): created successfully
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a131691d-1d91-43cf-8c20-8738c923441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (ab8b3236-d2f6-4605-8373-98877dbdff9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:14:59 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-e5c26539-b730-4b19-81c4-3152b16b76b9" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7b4f6f06-c267-4080-9e44-e59bce690432 tempest-CreateVolumesFromImageTest-294184903 None] Created volume successfully.
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-quobyte-e5c26539-b730-4b19-81c4-3152b16b76b9" released by "delete_volume" :: held 0.795s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Created reservations ['ecd2d26c-28f5-4d32-a4d4-d5e2f618f2f5', '1a182f1b-2fc5-4d92-9087-6a3253df56f8', '7979aca0-53dc-4dfe-a816-e40e44b492f5', '6d00b2bb-db97-45be-93fd-1371f7f5f239'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:59 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:14:59 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:14:59 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 1073741824" returned: 0 in 0.598s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:59 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.329s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:14:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Deleted volume successfully.
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:14:59 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2124c9af-0514-48ab-9c9f-962015b74271 tempest-CreateVolumesFromSnapshotTest-950734073 None] Lock "cinder-e5c26539-b730-4b19-81c4-3152b16b76b9-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:14:59 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498
Nov 05 12:14:59 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498" returned: 0 in 0.260s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.740s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1059602016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197c8837-1ca3-49cc-b697-d81defc4e1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965cd9bdaf6047b9be9567d5b279d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:57Z,use_quota=True,user_id='5501b2ac2d1a412087031a039d0bc3cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Creating volume 197c8837-1ca3-49cc-b697-d81defc4e1d9 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:00 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[105911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9 1073741824
Nov 05 12:15:00 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b634a0bf-a87d-4b26-8cb6-1ecddca08c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af993580-1726-47b2-bfc9-087720b89498', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a37e6a2-aa11-448a-a31c-55367981cc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:00 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Volume volume-af993580-1726-47b2-bfc9-087720b89498 (af993580-1726-47b2-bfc9-087720b89498): created successfully
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a37e6a2-aa11-448a-a31c-55367981cc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Flow 'volume_create_manager' (9cac79f4-c911-4f75-ba06-96aebf78c16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:00 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4c431427-7dcd-42ac-a76e-f72db3a03d83 tempest-VolumeDependencyTests-1793692043 None] Created volume successfully.
Nov 05 12:15:00 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9 1073741824" returned: 0 in 0.522s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:00 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9
Nov 05 12:15:00 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:00 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.296s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714735116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dca9b64-cb03-45de-8f3d-a5cb9710e263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:14:58Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Creating volume 1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:00 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:00 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea4fcb1-04ce-4f07-bf42-3652edfb7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197c8837-1ca3-49cc-b697-d81defc4e1d9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:01 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 1073741824
Nov 05 12:15:01 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9a4225-8f17-48d5-8db5-476572a372c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:01 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Volume volume-197c8837-1ca3-49cc-b697-d81defc4e1d9 (197c8837-1ca3-49cc-b697-d81defc4e1d9): created successfully
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9a4225-8f17-48d5-8db5-476572a372c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Flow 'volume_create_manager' (62186182-a54a-44d5-85bd-f72d4e3caec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:01 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c07a6ee5-f657-4d1e-859a-e8e0ae01ee14 tempest-CreateVolumesFromImageTest-294184903 None] Created volume successfully.
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:01 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 1073741824" returned: 0 in 0.598s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:01 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263
Nov 05 12:15:01 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-197c8837-1ca3-49cc-b697-d81defc4e1d9-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-197c8837-1ca3-49cc-b697-d81defc4e1d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-quobyte-197c8837-1ca3-49cc-b697-d81defc4e1d9" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-197c8837-1ca3-49cc-b697-d81defc4e1d9" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[96987bc2-51c2-4597-b891-9dbc4424871b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:01 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263" returned: 0 in 0.329s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.775s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bff1a7-6e34-432c-b383-7d3033765fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:01 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a380a3-f391-4181-a8a7-57b37cf314f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Creating offline snapshot 4534e715-2a59-4033-8c31-09e7c3d5f5c4 of volume af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:02 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Volume volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 (1dca9b64-cb03-45de-8f3d-a5cb9710e263): created successfully
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a380a3-f391-4181-a8a7-57b37cf314f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (427bddff-b8ef-49d2-a960-6072d138c939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b833db1-bc11-4e71-934f-de6d9c8a097e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:02 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9
Nov 05 12:15:02 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-631bfbbb-6942-43a1-b6c3-b353aa5841dd tempest-ProjectReaderTests-1185429902 None] Created volume successfully.
Nov 05 12:15:02 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498
Nov 05 12:15:02 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:02 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9" returned: 0 in 0.449s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:02 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9
Nov 05 12:15:02 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:02 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498" returned: 0 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:02 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 1G
Nov 05 12:15:02 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:02 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-197c8837-1ca3-49cc-b697-d81defc4e1d9" returned: 0 in 0.256s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-197c8837-1ca3-49cc-b697-d81defc4e1d9" released by "delete_volume" :: held 0.763s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Created reservations ['87174783-4cc3-4f47-81a9-c89cc26fd3b7', '1fdc03a1-6add-458c-ab81-e55d807f40cb', '1edab148-035c-4d97-bf03-e17bc89a727d', '100faeac-1803-4696-8849-8b69ddc7ad5d'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:02 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:02 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:03 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 1G" returned: 0 in 0.624s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af993580-1726-47b2-bfc9-087720b89498 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-f4e9cb80-01fb-413a-85c5-4f6ce22ca883-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:03 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af993580-1726-47b2-bfc9-087720b89498 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4
Nov 05 12:15:03 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-f4e9cb80-01fb-413a-85c5-4f6ce22ca883-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:03 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:03 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Deleted volume successfully.
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-quobyte-f4e9cb80-01fb-413a-85c5-4f6ce22ca883" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ca806e71-d07a-4044-84f0-692d5a400b1b tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-197c8837-1ca3-49cc-b697-d81defc4e1d9-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-f4e9cb80-01fb-413a-85c5-4f6ce22ca883" acquired by "delete_volume" :: waited 0.038s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Flow 'volume_create_manager' (84ca7678-a0f8-46de-a679-90972f4740be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befed750-293a-4200-9c4a-b84c9ee1f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d52c56f-1573-4350-8543-22b7a0d0b1b8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befed750-293a-4200-9c4a-b84c9ee1f009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bb4017-a738-4ba5-9820-39405a57f9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfff65ef4cf4dcba4b0a0036e3d622d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:03Z,use_quota=True,user_id='71e58653ccc444358adc99ba75e1f6e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc4183-fbb8-4fa1-916f-21feb02bd058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc4183-fbb8-4fa1-916f-21feb02bd058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f69a53-cecd-4c55-9073-08336fea71dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f69a53-cecd-4c55-9073-08336fea71dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9bb4017-a738-4ba5-9820-39405a57f9f0', 'volume_name': 'volume-d9bb4017-a738-4ba5-9820-39405a57f9f0', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5713d7-1baf-497f-94f8-5a8761cfe05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5713d7-1baf-497f-94f8-5a8761cfe05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad10b590-e764-4d8c-857d-ae66d20f8169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:03 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Volume d9bb4017-a738-4ba5-9820-39405a57f9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9bb4017-a738-4ba5-9820-39405a57f9f0', 'volume_size': 1}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af993580-1726-47b2-bfc9-087720b89498 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4" returned: 0 in 0.432s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 is being set with open permissions: ugo+rw
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4
Nov 05 12:15:03 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883
Nov 05 12:15:03 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.info
Nov 05 12:15:03 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:03 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883" returned: 0 in 0.429s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:03 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883
Nov 05 12:15:03 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:04 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.info" returned: 0 in 0.281s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.info is being set with open permissions: ugo+rw
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:04 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f4e9cb80-01fb-413a-85c5-4f6ce22ca883" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.info
Nov 05 12:15:04 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-f4e9cb80-01fb-413a-85c5-4f6ce22ca883" released by "delete_volume" :: held 0.838s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Created reservations ['657a5d9f-a057-47c4-b474-8db9b9170390', '9d7f970e-e3d8-42a2-901a-1750500d0672', '3065127d-cd89-496e-a87e-4a413f5513e5', 'cd2b6630-a2b8-40da-9a35-f82618d06810'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:04 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:04 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:04 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.info" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.385s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Creating offline snapshot 69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 of volume 1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4a4a0a4f-eff2-4b06-8725-08619848a910 tempest-VolumeDependencyTests-1793692043 None] Create snapshot completed successfully
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b7fd2-1c39-40de-a40c-38c57d313606]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:04 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:04 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263
Nov 05 12:15:04 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Deleted volume successfully.
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e9c9bf36-fddd-44e1-aeff-017e807071e5 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-f4e9cb80-01fb-413a-85c5-4f6ce22ca883-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:04 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263" returned: 0 in 0.359s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:04 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 1G
Nov 05 12:15:04 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 1G" returned: 0 in 0.402s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9
Nov 05 12:15:05 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-92803b3a-99d6-496b-98f1-28ff4d25bfa8-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-92803b3a-99d6-496b-98f1-28ff4d25bfa8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-quobyte-92803b3a-99d6-496b-98f1-28ff4d25bfa8" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-92803b3a-99d6-496b-98f1-28ff4d25bfa8" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7209535-225d-416c-bd0a-5558dabe1b91]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" returned: 0 in 0.311s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:05 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 is being set with open permissions: ugo+rw
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9
Nov 05 12:15:05 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8
Nov 05 12:15:05 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.info
Nov 05 12:15:05 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:05 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8" returned: 0 in 0.437s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:05 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8
Nov 05 12:15:05 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Flow 'volume_create_manager' (384270f7-066b-4696-ba58-5775161032a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30792f07-06a5-48c6-a388-6ef3632b0e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30792f07-06a5-48c6-a388-6ef3632b0e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1091445560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aecc9e5-2feb-4691-ad04-471ae387c957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d889baeec7e0466f82df734984fcdae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4534e715-2a59-4033-8c31-09e7c3d5f5c4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:06Z,use_quota=True,user_id='591695d781de4cf992a522c134a64436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c57a45b-2e0d-4843-8960-f4d6c05f8165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c57a45b-2e0d-4843-8960-f4d6c05f8165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb533993-d117-45cb-9e46-52f60e8c6f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb533993-d117-45cb-9e46-52f60e8c6f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8aecc9e5-2feb-4691-ad04-471ae387c957', 'volume_name': 'volume-8aecc9e5-2feb-4691-ad04-471ae387c957', 'volume_size': 1, 'snapshot_id': '4534e715-2a59-4033-8c31-09e7c3d5f5c4'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b85e99-81c0-4a3c-b785-03b11fb13188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b85e99-81c0-4a3c-b785-03b11fb13188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad7ecda-e7c5-4102-8d9b-7cb9e1641fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:06 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Volume 8aecc9e5-2feb-4691-ad04-471ae387c957: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8aecc9e5-2feb-4691-ad04-471ae387c957', 'volume_size': 1, 'snapshot_id': '4534e715-2a59-4033-8c31-09e7c3d5f5c4'}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:06 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.info" returned: 0 in 0.285s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:06 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.info is being set with open permissions: ugo+rw
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:06 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.info
Nov 05 12:15:06 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:06 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-92803b3a-99d6-496b-98f1-28ff4d25bfa8" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-92803b3a-99d6-496b-98f1-28ff4d25bfa8" released by "delete_volume" :: held 0.754s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Created reservations ['66f5cb87-65b7-4639-a0a1-09a14378605d', '596745db-d1ac-4e7e-b235-d53cb0a81b99', 'b0bfd17e-86fe-49c1-9fe9-ddb366a5ccd8', '434635f9-f650-4cfd-8ed1-f7cb73f4a30a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:06 devstack sudo[106016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:06 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:06 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.info" returned: 0 in 0.268s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.948s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bb4017-a738-4ba5-9820-39405a57f9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfff65ef4cf4dcba4b0a0036e3d622d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:03Z,use_quota=True,user_id='71e58653ccc444358adc99ba75e1f6e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Creating volume d9bb4017-a738-4ba5-9820-39405a57f9f0 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:06 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:06 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0 1073741824
Nov 05 12:15:06 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f218ffa8-3875-4a14-b0ad-27d54a7713f1 tempest-ProjectReaderTests-1185429902 None] Create snapshot completed successfully
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-ff3c5716-2c28-4576-a2a0-f097bd88c7bb-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-ff3c5716-2c28-4576-a2a0-f097bd88c7bb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-quobyte-ff3c5716-2c28-4576-a2a0-f097bd88c7bb" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-ff3c5716-2c28-4576-a2a0-f097bd88c7bb" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:06 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.322s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:06 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Deleted volume successfully.
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1552f915-6078-4c2a-8ca9-3ab49eab276f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0c0890ef-2539-45a5-9d26-3c19d324b308 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-92803b3a-99d6-496b-98f1-28ff4d25bfa8-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:06 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb
Nov 05 12:15:06 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:06 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:06 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0 1073741824" returned: 0 in 0.508s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0
Nov 05 12:15:07 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb" returned: 0 in 0.401s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb
Nov 05 12:15:07 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-69cf8135-5207-4ba4-a04e-0a2c7bbc37a9-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-69cf8135-5207-4ba4-a04e-0a2c7bbc37a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-1dca9b64-cb03-45de-8f3d-a5cb9710e263" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-1dca9b64-cb03-45de-8f3d-a5cb9710e263" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Deleting offline snapshot 69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 of volume 1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] snapshot_file for this snap is: volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:07 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0" returned: 0 in 0.294s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.205s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-quobyte-4534e715-2a59-4033-8c31-09e7c3d5f5c4-8aecc9e5-2feb-4691-ad04-471ae387c957" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad10b590-e764-4d8c-857d-ae66d20f8169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9bb4017-a738-4ba5-9820-39405a57f9f0', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bc5e9c-f40a-43d8-812c-a8f9828bfb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2df114-12eb-447b-9f9c-fb397c21d692]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-4534e715-2a59-4033-8c31-09e7c3d5f5c4-8aecc9e5-2feb-4691-ad04-471ae387c957" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Creating volume 8aecc9e5-2feb-4691-ad04-471ae387c957 from snapshot 4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-quobyte-8aecc9e5-2feb-4691-ad04-471ae387c957" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:07 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Volume volume-d9bb4017-a738-4ba5-9820-39405a57f9f0 (d9bb4017-a738-4ba5-9820-39405a57f9f0): created successfully
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bc5e9c-f40a-43d8-812c-a8f9828bfb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Flow 'volume_create_manager' (84ca7678-a0f8-46de-a679-90972f4740be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:07 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-ff3c5716-2c28-4576-a2a0-f097bd88c7bb" returned: 0 in 0.307s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-ff3c5716-2c28-4576-a2a0-f097bd88c7bb" released by "delete_volume" :: held 0.769s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-8aecc9e5-2feb-4691-ad04-471ae387c957" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] snapshot: 4534e715-2a59-4033-8c31-09e7c3d5f5c4, volume: 8aecc9e5-2feb-4691-ad04-471ae387c957,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:15:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4e30709e-abf3-49fe-8745-4420cf568781 tempest-CinderUnicodeTest-2084286066 None] Created volume successfully.
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:07 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9
Nov 05 12:15:07 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c47e10-1569-465a-9df5-2d2bb4cb68eb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Created reservations ['44f2cdff-2a6b-4c48-8ce7-6e46602215ab', '06feb96e-5a8f-4350-9bdf-799840aa7ef2', '92f49110-46e5-4a90-8a0a-288c6b40cc41', 'f0f2ce52-6fc2-4bf9-8675-0419c4d3ccde'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:07 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4
Nov 05 12:15:07 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:07 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:07 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" returned: 0 in 0.452s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-c3f4aad9-a028-4f7c-bcf4-695e890f2979-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[af306110-f839-4a3e-bb0d-0047870988e0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-c3f4aad9-a028-4f7c-bcf4-695e890f2979-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "cinder-quobyte-c3f4aad9-a028-4f7c-bcf4-695e890f2979" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:07 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.309s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:07 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Deleted volume successfully.
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-c3f4aad9-a028-4f7c-bcf4-695e890f2979" acquired by "delete_volume" :: waited 0.031s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:07 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5e2697b2-d049-4f83-8cd7-1b6fca1cc836 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-ff3c5716-2c28-4576-a2a0-f097bd88c7bb-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e1206-1b8a-4a24-8325-8ab2a55329be]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4" returned: 0 in 0.527s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af993580-1726-47b2-bfc9-087720b89498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d3d6aa-3fe9-4a76-b932-82d0c4371c78]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263
Nov 05 12:15:08 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979
Nov 05 12:15:08 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498
Nov 05 12:15:08 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263" returned: 0 in 0.490s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9
Nov 05 12:15:08 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979
Nov 05 12:15:08 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498" returned: 0 in 0.424s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957
Nov 05 12:15:08 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c3f4aad9-a028-4f7c-bcf4-695e890f2979" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-quobyte-c3f4aad9-a028-4f7c-bcf4-695e890f2979" released by "delete_volume" :: held 0.778s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:08 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" returned: 0 in 0.426s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9
Nov 05 12:15:08 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Created reservations ['1a376393-a178-4bed-8bde-9a7d175cae97', '3f1bba3f-beaf-4dab-b12e-874b42f6b95e', '70a2bb19-4b0e-4380-96f3-fb558959fbb9', '13f629ea-04a3-4e7b-8290-70f55dc9b157'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:08 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:08 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:09 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263.69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" returned: 0 in 0.426s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-69cf8135-5207-4ba4-a04e-0a2c7bbc37a9" released by "_delete_snapshot" :: held 1.996s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-1dca9b64-cb03-45de-8f3d-a5cb9710e263" released by "delete_snapshot" :: held 2.045s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:09 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Flow 'volume_create_manager' (d9de31d9-1e6f-4b69-bac7-8a88baed62d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a15930-44e1-4262-8c8c-9d3068078d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.608s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Created reservations ['d07b78c5-dd5b-48ef-8306-0d2ac39bd009', '89f3809d-3b99-49de-a0cd-2b3059c2f722', '4868d5ce-9938-4d5c-8fc5-5cc2889d047c', 'c765b031-8d90-4769-906f-b5e907792e2d'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a15930-44e1-4262-8c8c-9d3068078d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1396581932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7373528c-4b2b-429e-b2a0-52f47d7edd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfff65ef4cf4dcba4b0a0036e3d622d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:09Z,use_quota=True,user_id='71e58653ccc444358adc99ba75e1f6e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11567e77-35dc-41c4-9549-45307153a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11567e77-35dc-41c4-9549-45307153a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77faabae-b723-4fcd-8589-5a8a8c68c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77faabae-b723-4fcd-8589-5a8a8c68c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7373528c-4b2b-429e-b2a0-52f47d7edd83', 'volume_name': 'volume-7373528c-4b2b-429e-b2a0-52f47d7edd83', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f28838-dd45-41b9-aeb9-332b11e69a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f28838-dd45-41b9-aeb9-332b11e69a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6246e117-04ee-4998-ae7e-40d59803077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:09 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Volume 7373528c-4b2b-429e-b2a0-52f47d7edd83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7373528c-4b2b-429e-b2a0-52f47d7edd83', 'volume_size': 1}
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:09 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Deleted volume successfully.
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-eeb2adb7-e40a-4f45-ae2b-3ee4ddc30fd7 tempest-CreateVolumesFromImageTest-294184903 None] Lock "cinder-c3f4aad9-a028-4f7c-bcf4-695e890f2979-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:09 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Delete snapshot completed successfully.
Nov 05 12:15:09 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b0eae71-42a4-41e3-b731-60e8211a26b1 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-69cf8135-5207-4ba4-a04e-0a2c7bbc37a9-delete_snapshot" released by "delete_snapshot" :: held 2.568s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-1dca9b64-cb03-45de-8f3d-a5cb9710e263-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-1dca9b64-cb03-45de-8f3d-a5cb9710e263-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-1dca9b64-cb03-45de-8f3d-a5cb9710e263" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-1dca9b64-cb03-45de-8f3d-a5cb9710e263" acquired by "delete_volume" :: waited 0.037s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:11 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ea15f-8d53-4533-8e1f-e3eaeb9b5aa5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:11 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263
Nov 05 12:15:11 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:11 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263" returned: 0 in 0.666s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:11 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263
Nov 05 12:15:11 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:12 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-1dca9b64-cb03-45de-8f3d-a5cb9710e263" returned: 0 in 0.541s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-1dca9b64-cb03-45de-8f3d-a5cb9710e263" released by "delete_volume" :: held 1.353s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Created reservations ['2fd65a57-bd9c-44d5-902b-74f2d357bedc', '7c13dc4a-02d5-47ee-a16e-2256ea08c11f', '07f79bb6-c958-43e7-884b-3736238cfd8b', '358a089c-5c22-4e93-8a69-2c03387d0e3a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:12 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:12 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:13 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.474s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:13 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Deleted volume successfully.
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-902fa485-3d59-4dbc-b1f0-e2bb01d96952 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-1dca9b64-cb03-45de-8f3d-a5cb9710e263-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:13 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:13 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (76200ccc-a9ed-4461-bbc3-374b35dbb581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6210a4-a84e-4ece-9e34-6ebba6752a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6210a4-a84e-4ece-9e34-6ebba6752a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-809431329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b209c3b-2c74-49d8-9935-1259a4936d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:14Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92750031-80b2-4079-adc8-34dc8404e200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92750031-80b2-4079-adc8-34dc8404e200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc4d76e-87cd-4ba2-a6f1-0f177db3598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc4d76e-87cd-4ba2-a6f1-0f177db3598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b209c3b-2c74-49d8-9935-1259a4936d73', 'volume_name': 'volume-6b209c3b-2c74-49d8-9935-1259a4936d73', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c8ae58-eb97-4d03-93c7-c718f46a7ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c8ae58-eb97-4d03-93c7-c718f46a7ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30c11a3-30ef-4061-aa52-d29fd3c25172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:14 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Volume 6b209c3b-2c74-49d8-9935-1259a4936d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b209c3b-2c74-49d8-9935-1259a4936d73', 'volume_size': 1}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:14 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.968s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:15:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:15:16 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957" returned: 0 in 8.111s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:15:16 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Converted 1024.00 MB image at 126.23 MB/s
Nov 05 12:15:16 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957 is being set with open permissions: ugo+rw
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:16 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957
Nov 05 12:15:16 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:16 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957" returned: 0 in 0.264s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-8aecc9e5-2feb-4691-ad04-471ae387c957" released by "_copy_volume_from_snapshot" :: held 9.422s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-4534e715-2a59-4033-8c31-09e7c3d5f5c4-8aecc9e5-2feb-4691-ad04-471ae387c957" released by "_create_volume_from_snapshot" :: held 9.530s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.585s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.237s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1396581932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7373528c-4b2b-429e-b2a0-52f47d7edd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfff65ef4cf4dcba4b0a0036e3d622d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:09Z,use_quota=True,user_id='71e58653ccc444358adc99ba75e1f6e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Creating volume 7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:16 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:16 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 1073741824
Nov 05 12:15:16 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad7ecda-e7c5-4102-8d9b-7cb9e1641fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aecc9e5-2feb-4691-ad04-471ae387c957', 'volume_size': 1, 'snapshot_id': '4534e715-2a59-4033-8c31-09e7c3d5f5c4'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efe3e1a-fd80-420c-bfd6-935b14f079d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:16 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Volume volume-8aecc9e5-2feb-4691-ad04-471ae387c957 (8aecc9e5-2feb-4691-ad04-471ae387c957): created successfully
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efe3e1a-fd80-420c-bfd6-935b14f079d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:16 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Flow 'volume_create_manager' (384270f7-066b-4696-ba58-5775161032a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3d4ef448-7732-41a6-bad4-5cb676bd4668 tempest-VolumeDependencyTests-1793692043 None] Created volume successfully.
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-4534e715-2a59-4033-8c31-09e7c3d5f5c4-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-4534e715-2a59-4033-8c31-09e7c3d5f5c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-quobyte-af993580-1726-47b2-bfc9-087720b89498" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-af993580-1726-47b2-bfc9-087720b89498" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-quobyte-4534e715-2a59-4033-8c31-09e7c3d5f5c4" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-4534e715-2a59-4033-8c31-09e7c3d5f5c4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Deleting offline snapshot 4534e715-2a59-4033-8c31-09e7c3d5f5c4 of volume af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] snapshot_file for this snap is: volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b070dab3-1c4d-42a2-8da0-57fa0eb33fff]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:17 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 1073741824" returned: 0 in 0.556s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:17 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83
Nov 05 12:15:17 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:17 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4
Nov 05 12:15:17 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:17 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83" returned: 0 in 0.306s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.592s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-809431329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b209c3b-2c74-49d8-9935-1259a4936d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:14Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Creating volume 6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:17 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:17 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4" returned: 0 in 0.420s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af993580-1726-47b2-bfc9-087720b89498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:17 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 1073741824
Nov 05 12:15:17 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6246e117-04ee-4998-ae7e-40d59803077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7373528c-4b2b-429e-b2a0-52f47d7edd83', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b572513-bf72-4255-9fb5-969518f87f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46b29d2-3a42-4db5-8ffb-f5ad842474a1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:17 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Volume volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 (7373528c-4b2b-429e-b2a0-52f47d7edd83): created successfully
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b572513-bf72-4255-9fb5-969518f87f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Flow 'volume_create_manager' (d9de31d9-1e6f-4b69-bac7-8a88baed62d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:17 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e1906612-e497-4a49-bca6-3efbc4ab3f65 tempest-CinderUnicodeTest-2084286066 None] Created volume successfully.
Nov 05 12:15:18 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498
Nov 05 12:15:18 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:18 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 1073741824" returned: 0 in 0.508s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:18 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73
Nov 05 12:15:18 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:18 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498" returned: 0 in 0.698s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:18 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4
Nov 05 12:15:18 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:18 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73" returned: 0 in 0.325s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30c11a3-30ef-4061-aa52-d29fd3c25172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b209c3b-2c74-49d8-9935-1259a4936d73', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe28193c-338a-4f2d-b39d-30c7b8d95b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:18 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Volume volume-6b209c3b-2c74-49d8-9935-1259a4936d73 (6b209c3b-2c74-49d8-9935-1259a4936d73): created successfully
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe28193c-338a-4f2d-b39d-30c7b8d95b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (76200ccc-a9ed-4461-bbc3-374b35dbb581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4b8ba063-720e-40e3-8271-9500d2767fbe tempest-ProjectReaderTests-1185429902 None] Created volume successfully.
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Flow 'volume_create_manager' (dc4d446e-58b6-4584-88b3-ee12865b01e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec91275-90f8-496e-a3d3-d05a3358c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec91275-90f8-496e-a3d3-d05a3358c405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0dba0c-6965-46f1-a090-6fe1799b6477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9ba4e0fc53470d814a0cc174192e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:19Z,use_quota=True,user_id='bc927a681b9348a989e6bbd5b1449602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac72ebbf-e900-48c0-86be-7a28b4ffe850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac72ebbf-e900-48c0-86be-7a28b4ffe850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9864e9-2ca9-4edc-959d-dd8ad8832a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.image.glance [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Creating Keystone auth plugin from conf {{(pid=87317) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:19 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Creating offline snapshot 9a519ad8-3667-48cd-b5cc-51d7a9096d77 of volume 7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4" returned: 0 in 0.442s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2034412-a4a7-4b00-a416-50b9b28c4634]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:19 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4
Nov 05 12:15:19 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:19 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83
Nov 05 12:15:19 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9864e9-2ca9-4edc-959d-dd8ad8832a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c0dba0c-6965-46f1-a090-6fe1799b6477', 'volume_name': 'volume-2c0dba0c-6965-46f1-a090-6fe1799b6477', 'volume_size': 1, 'image_id': 'a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c563433b97a8596ba42bc711cb269978', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad9ba4e0fc53470d814a0cc174192e87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '305f96afc3219e7d8f2df0a27042fdff4bb03fef0c811e2064f8116b2ea2ca9667a7b541cc8636ec1fc3c9e869a4031a288138a53f3a7bf5ad963bd9649e0d02', 'id': 'a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'created_at': datetime.datetime(2026, 11, 5, 11, 15, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028d92a50>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169d9856-d465-442c-9066-7305aba0ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169d9856-d465-442c-9066-7305aba0ddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:19 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5757c5-f8cd-405b-a835-83bb46782c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:19 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Volume 2c0dba0c-6965-46f1-a090-6fe1799b6477: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c0dba0c-6965-46f1-a090-6fe1799b6477', 'volume_size': 1, 'image_id': 'a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c563433b97a8596ba42bc711cb269978', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad9ba4e0fc53470d814a0cc174192e87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '305f96afc3219e7d8f2df0a27042fdff4bb03fef0c811e2064f8116b2ea2ca9667a7b541cc8636ec1fc3c9e869a4031a288138a53f3a7bf5ad963bd9649e0d02', 'id': 'a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'created_at': datetime.datetime(2026, 11, 5, 11, 15, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028d92a50>}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Trying to clone 2c0dba0c-6965-46f1-a090-6fe1799b6477 from image a4998f4b-b28d-4b6f-be99-c7f576182e1b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'metadata': {}}]). {{(pid=87317) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498.4534e715-2a59-4033-8c31-09e7c3d5f5c4" returned: 0 in 0.292s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-4534e715-2a59-4033-8c31-09e7c3d5f5c4" released by "_delete_snapshot" :: held 2.010s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-af993580-1726-47b2-bfc9-087720b89498" released by "delete_snapshot" :: held 2.044s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Created reservations ['1f404a77-8ce5-47e0-ac99-79d72854cd70', '616372a4-7201-4c92-b97d-d4ac8799358d', '01b269b9-7fa3-436f-8686-c403ea875661', '2209f779-408b-4bfd-9041-e20dd95792b2'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 12:15:19 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 12:15:19 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83" returned: 0 in 0.464s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:19 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 1G
Nov 05 12:15:19 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a96669-0856-4ab9-ae2e-21ecff803891]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:19 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Delete snapshot completed successfully.
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-45bd1c2c-009b-4dad-b9e4-f7577665d7f3 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-4534e715-2a59-4033-8c31-09e7c3d5f5c4-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:19 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD
Nov 05 12:15:19 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:19 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 1G" returned: 0 in 0.459s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77
Nov 05 12:15:20 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD
Nov 05 12:15:20 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 is being set with open permissions: ugo+rw
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Temporary image a4998f4b-b28d-4b6f-be99-c7f576182e1b is fetched for user bc927a681b9348a989e6bbd5b1449602. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 12:15:20 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77
Nov 05 12:15:20 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f044a80-3077-4fbe-abd1-69b7a8c3760f]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD
Nov 05 12:15:20 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77" returned: 0 in 0.268s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-af993580-1726-47b2-bfc9-087720b89498-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-af993580-1726-47b2-bfc9-087720b89498-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:20 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.info
Nov 05 12:15:20 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-quobyte-af993580-1726-47b2-bfc9-087720b89498" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-af993580-1726-47b2-bfc9-087720b89498" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:20 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c8a69-19be-4ef5-8442-9258ca029bb9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD
Nov 05 12:15:20 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498
Nov 05 12:15:20 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:20 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.info" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:20 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.info is being set with open permissions: ugo+rw
Nov 05 12:15:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:20 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.info
Nov 05 12:15:20 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:21 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:21 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498" returned: 0 in 0.380s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:21 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498
Nov 05 12:15:21 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:21 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.info" returned: 0 in 0.281s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.494s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Creating offline snapshot 401f5697-610f-46fa-8ac7-da954eced200 of volume 6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-680c1bd9-ddd2-457f-8f94-4f0d8034b06a tempest-CinderUnicodeTest-2084286066 None] Create snapshot completed successfully
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[485de1b9-1a02-44b0-b578-c2250f7dc4dd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:21 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73
Nov 05 12:15:21 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:21 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-af993580-1726-47b2-bfc9-087720b89498" returned: 0 in 0.269s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-af993580-1726-47b2-bfc9-087720b89498" released by "delete_volume" :: held 0.725s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Created reservations ['b6414000-7ac7-498b-98aa-f39a5996a325', 'cc71eaa2-5b59-4102-af12-3510dd7b6ddb', '1dd93ead-3b58-477d-bf4b-ce971901b169', 'e75cf783-8c0c-417e-ba7b-5de7189fefd1'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:21 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:21 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:21 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73" returned: 0 in 0.384s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:21 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 1G
Nov 05 12:15:21 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-8aecc9e5-2feb-4691-ad04-471ae387c957-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-8aecc9e5-2feb-4691-ad04-471ae387c957-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:21 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.289s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Deleted volume successfully.
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "cinder-quobyte-8aecc9e5-2feb-4691-ad04-471ae387c957" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-8aecc9e5-2feb-4691-ad04-471ae387c957" acquired by "delete_volume" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-db3d8294-20dc-4efd-8d0d-a3dd5ffb8569 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-af993580-1726-47b2-bfc9-087720b89498-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca86d3-01f8-450f-aff2-74293fb47ee6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957
Nov 05 12:15:22 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "cinder-9a519ad8-3667-48cd-b5cc-51d7a9096d77-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-9a519ad8-3667-48cd-b5cc-51d7a9096d77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "cinder-quobyte-7373528c-4b2b-429e-b2a0-52f47d7edd83" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-7373528c-4b2b-429e-b2a0-52f47d7edd83" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "cinder-quobyte-9a519ad8-3667-48cd-b5cc-51d7a9096d77" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-9a519ad8-3667-48cd-b5cc-51d7a9096d77" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Deleting offline snapshot 9a519ad8-3667-48cd-b5cc-51d7a9096d77 of volume 7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] snapshot_file for this snap is: volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[20248913-d13b-449f-a34b-7cbfef11086a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 1G" returned: 0 in 0.568s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b209c3b-2c74-49d8-9935-1259a4936d73 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b209c3b-2c74-49d8-9935-1259a4936d73 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200
Nov 05 12:15:22 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77
Nov 05 12:15:22 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957" returned: 0 in 0.435s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957
Nov 05 12:15:22 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b209c3b-2c74-49d8-9935-1259a4936d73 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200" returned: 0 in 0.310s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 is being set with open permissions: ugo+rw
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200
Nov 05 12:15:22 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77" returned: 0 in 0.388s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7373528c-4b2b-429e-b2a0-52f47d7edd83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[56933f85-3c08-47e5-89c2-9aa38f0dc2e6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-8aecc9e5-2feb-4691-ad04-471ae387c957" returned: 0 in 0.270s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-quobyte-8aecc9e5-2feb-4691-ad04-471ae387c957" released by "delete_volume" :: held 0.763s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Created reservations ['a98f62e7-a243-48c4-b7bb-0632acaea88b', 'ea4aca52-b78b-4804-94ea-b1ad6da90f67', '61970292-f111-4d00-854f-67127141da6d', '14571403-72de-4082-bfad-96b6718f631f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:22 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83
Nov 05 12:15:22 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:22 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:22 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200" returned: 0 in 0.280s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:22 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.info
Nov 05 12:15:22 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:23 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83" returned: 0 in 0.481s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:23 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.329s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Deleted volume successfully.
Nov 05 12:15:23 devstack sudo[106285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77
Nov 05 12:15:23 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-2ce4c7da-8a96-4efc-9f4b-68b6d73dc298 tempest-VolumeDependencyTests-1793692043 None] Lock "cinder-8aecc9e5-2feb-4691-ad04-471ae387c957-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:23 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.info" returned: 0 in 0.347s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:23 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.info is being set with open permissions: ugo+rw
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:23 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.info
Nov 05 12:15:23 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:23 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.info" returned: 0 in 0.288s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:23 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.445s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0dba0c-6965-46f1-a090-6fe1799b6477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9ba4e0fc53470d814a0cc174192e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:19Z,use_quota=True,user_id='bc927a681b9348a989e6bbd5b1449602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Creating volume 2c0dba0c-6965-46f1-a090-6fe1799b6477 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:23 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77" returned: 0 in 0.447s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:23 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 1073741824
Nov 05 12:15:23 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:23 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77
Nov 05 12:15:23 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:23 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-17063558-2557-4dd8-b6d2-79cfce529811 tempest-ProjectReaderTests-1185429902 None] Create snapshot completed successfully
Nov 05 12:15:23 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83.9a519ad8-3667-48cd-b5cc-51d7a9096d77" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-9a519ad8-3667-48cd-b5cc-51d7a9096d77" released by "_delete_snapshot" :: held 1.735s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-7373528c-4b2b-429e-b2a0-52f47d7edd83" released by "delete_snapshot" :: held 1.768s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:23 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Created reservations ['18a89b86-d320-4b41-9288-4d51836da956', '78ff1206-7f2e-4d2e-9212-9ef1430c1e33', '18eb02aa-e314-4bc4-87c9-a15b7247582b', '9e8725e6-4614-490f-a2d6-8abb9d139eab'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-401f5697-610f-46fa-8ac7-da954eced200-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Lock "cinder-401f5697-610f-46fa-8ac7-da954eced200-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-6b209c3b-2c74-49d8-9935-1259a4936d73" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-6b209c3b-2c74-49d8-9935-1259a4936d73" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-401f5697-610f-46fa-8ac7-da954eced200" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Delete snapshot completed successfully.
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-401f5697-610f-46fa-8ac7-da954eced200" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Deleting offline snapshot 401f5697-610f-46fa-8ac7-da954eced200 of volume 6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] snapshot_file for this snap is: volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c207be98-27aa-4a39-aeaf-fa9a20c632c2 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-9a519ad8-3667-48cd-b5cc-51d7a9096d77-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d67eab3-7abb-4c1c-a798-544574b0a055]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:24 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 1073741824" returned: 0 in 0.630s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:24 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477
Nov 05 12:15:24 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:24 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "cinder-7373528c-4b2b-429e-b2a0-52f47d7edd83-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:24 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-7373528c-4b2b-429e-b2a0-52f47d7edd83-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "cinder-quobyte-7373528c-4b2b-429e-b2a0-52f47d7edd83" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-7373528c-4b2b-429e-b2a0-52f47d7edd83" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8064338-3ffc-4e0a-a2cb-a1367986656d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:24 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477" returned: 0 in 0.314s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Attempting download of a4998f4b-b28d-4b6f-be99-c7f576182e1b ((None, [{'url': 'file:///opt/stack/data/glance/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'metadata': {}}])) to volume 2c0dba0c-6965-46f1-a090-6fe1799b6477. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43bb1e-ec9a-4d0a-9718-569bd1a37130]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4998f4b-b28d-4b6f-be99-c7f576182e1b_9bh5a15j {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:24 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83
Nov 05 12:15:24 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:24 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200" returned: 0 in 0.589s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b209c3b-2c74-49d8-9935-1259a4936d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:24 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4998f4b-b28d-4b6f-be99-c7f576182e1b_9bh5a15j
Nov 05 12:15:24 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b70ce-4d2f-4784-bb39-d37f11a127d6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:24 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73
Nov 05 12:15:24 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83" returned: 0 in 0.509s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4998f4b-b28d-4b6f-be99-c7f576182e1b_9bh5a15j" returned: 0 in 0.404s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4998f4b-b28d-4b6f-be99-c7f576182e1b_9bh5a15j {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83
Nov 05 12:15:25 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4998f4b-b28d-4b6f-be99-c7f576182e1b_9bh5a15j
Nov 05 12:15:25 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73" returned: 0 in 0.482s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200
Nov 05 12:15:25 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7373528c-4b2b-429e-b2a0-52f47d7edd83" returned: 0 in 0.334s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-7373528c-4b2b-429e-b2a0-52f47d7edd83" released by "delete_volume" :: held 0.925s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Created reservations ['07dd9f30-6e1a-46b9-8c9e-9e7105bbda3f', 'c22b9b38-7147-4adc-88a2-c1a96fe1ba1b', 'e9eaf63c-89eb-441c-9a85-54a0b10b499f', '40836593-b7a1-4ef5-a0d8-f0455249c0ea'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:25 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4998f4b-b28d-4b6f-be99-c7f576182e1b_9bh5a15j" returned: 1 in 0.416s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4998f4b-b28d-4b6f-be99-c7f576182e1b_9bh5a15j' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbed3cf-17f1-4928-bd2e-a56cdf62efcc]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:25 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD
Nov 05 12:15:25 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200" returned: 0 in 0.447s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200
Nov 05 12:15:25 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:25 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:25 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.346s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:25 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:25 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Deleted volume successfully.
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e43191f6-2b25-404b-9cfb-e85736d46cf9 tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-7373528c-4b2b-429e-b2a0-52f47d7edd83-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:26 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73.401f5697-610f-46fa-8ac7-da954eced200" returned: 0 in 0.291s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:26 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD
Nov 05 12:15:26 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-401f5697-610f-46fa-8ac7-da954eced200" released by "_delete_snapshot" :: held 1.961s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-6b209c3b-2c74-49d8-9935-1259a4936d73" released by "delete_snapshot" :: held 1.998s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Created reservations ['ba0a27ec-a7c4-4f52-9a6c-953d54adaf94', '51fd8f72-7c93-4077-8312-a2bbd75ffab2', '95b87c75-3bd9-49e1-a6e0-9ccab1d4adb6', 'e8643f5d-31ef-4e1c-a4a3-507f4327a617'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:26 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Delete snapshot completed successfully.
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e59f8e1e-7b10-4b30-a6ba-f1d08f04879c tempest-ProjectReaderTests-1185429902 None] Lock "cinder-401f5697-610f-46fa-8ac7-da954eced200-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:26 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] a4998f4b-b28d-4b6f-be99-c7f576182e1b was raw, converting to qcow2 {{(pid=87317) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:26 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477
Nov 05 12:15:26 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "cinder-d9bb4017-a738-4ba5-9820-39405a57f9f0-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-d9bb4017-a738-4ba5-9820-39405a57f9f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "cinder-quobyte-d9bb4017-a738-4ba5-9820-39405a57f9f0" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-d9bb4017-a738-4ba5-9820-39405a57f9f0" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a6f7d-5e0e-4c01-8dfa-820ff1adcc09]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:26 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477" returned: 0 in 0.549s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4998f4b-b28d-4b6f-be99-c7f576182e1b_cyri0qerdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:15:26 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 12:15:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:26 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0
Nov 05 12:15:26 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:26 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 1G
Nov 05 12:15:26 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:27 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:27 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0
Nov 05 12:15:27 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:27 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 1G" returned: 0 in 0.387s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Downloaded image a4998f4b-b28d-4b6f-be99-c7f576182e1b ((None, [{'url': 'file:///opt/stack/data/glance/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'metadata': {}}])) to volume 2c0dba0c-6965-46f1-a090-6fe1799b6477 successfully. {{(pid=87317) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Temporary image a4998f4b-b28d-4b6f-be99-c7f576182e1b for user bc927a681b9348a989e6bbd5b1449602 is deleted. {{(pid=87317) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.volume_utils [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Marking volume 2c0dba0c-6965-46f1-a090-6fe1799b6477 as bootable. {{(pid=87317) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=232,cinder:UPDATE=291,cinder:DELETE=26,cinder:INSERT=78 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Copying metadata from image a4998f4b-b28d-4b6f-be99-c7f576182e1b to 2c0dba0c-6965-46f1-a090-6fe1799b6477. {{(pid=87317) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Creating volume glance metadata for volume 2c0dba0c-6965-46f1-a090-6fe1799b6477 backed by image a4998f4b-b28d-4b6f-be99-c7f576182e1b with: {'image_id': 'a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c563433b97a8596ba42bc711cb269978', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87317) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:UPDATE=321,cinder:SELECT=218,cinder:INSERT=81,cinder:DELETE=28 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-6b209c3b-2c74-49d8-9935-1259a4936d73-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-6b209c3b-2c74-49d8-9935-1259a4936d73-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5757c5-f8cd-405b-a835-83bb46782c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0dba0c-6965-46f1-a090-6fe1799b6477', 'volume_size': 1, 'image_id': 'a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c563433b97a8596ba42bc711cb269978', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad9ba4e0fc53470d814a0cc174192e87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '305f96afc3219e7d8f2df0a27042fdff4bb03fef0c811e2064f8116b2ea2ca9667a7b541cc8636ec1fc3c9e869a4031a288138a53f3a7bf5ad963bd9649e0d02', 'id': 'a4998f4b-b28d-4b6f-be99-c7f576182e1b', 'created_at': datetime.datetime(2026, 11, 5, 11, 15, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 11, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4998f4b-b28d-4b6f-be99-c7f576182e1b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cd028d92a50>}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b48d16f-0472-4129-8986-1be705ea69b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-6b209c3b-2c74-49d8-9935-1259a4936d73" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Volume volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 (2c0dba0c-6965-46f1-a090-6fe1799b6477): created successfully
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b48d16f-0472-4129-8986-1be705ea69b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Flow 'volume_create_manager' (dc4d446e-58b6-4584-88b3-ee12865b01e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:27 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-6b209c3b-2c74-49d8-9935-1259a4936d73" acquired by "delete_volume" :: waited 0.050s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d9bb4017-a738-4ba5-9820-39405a57f9f0" returned: 0 in 0.418s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-68f7903a-6a4f-4823-b068-bdef345f74e9 tempest-VolumeImageDependencyTests-2055859848 None] Created volume successfully.
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85b72c-cffc-4ccc-9586-7d70c09407c8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (2c78ef9e-1811-4922-973a-672278a30b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c1499b-95fd-4bb9-a362-f077898cce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-quobyte-d9bb4017-a738-4ba5-9820-39405a57f9f0" released by "delete_volume" :: held 0.910s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c1499b-95fd-4bb9-a362-f077898cce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1692598941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:28Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62e0dfe-5980-4c48-b0c6-b1f969aea75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62e0dfe-5980-4c48-b0c6-b1f969aea75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3aca46b-650f-4e04-aae8-227f84a0ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3aca46b-650f-4e04-aae8-227f84a0ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c', 'volume_name': 'volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec2ff7e-24d2-4f9d-9c94-56b4ea386faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec2ff7e-24d2-4f9d-9c94-56b4ea386faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6b13b5-cb46-4df4-b731-689654db2ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:27 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Volume 3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c', 'volume_size': 1}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1692598941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:28Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Creating volume 3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:27 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:27 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c 1073741824
Nov 05 12:15:27 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:27 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73
Nov 05 12:15:27 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Created reservations ['fb4dbbd2-dc50-4212-98e2-6be9b7a12949', '2106589f-6374-44e5-9cfb-8ff0bc392996', '4f6f10bf-28e0-45c5-850c-303503f0f5c9', '6e4b55ee-3703-4a27-9ea0-f30ccd0cce81'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:27 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:27 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:28 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:28 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73
Nov 05 12:15:28 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:28 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.256s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Deleted volume successfully.
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bc578554-a379-489c-bd59-9ac234b4592b tempest-CinderUnicodeTest-2084286066 None] Lock "cinder-d9bb4017-a738-4ba5-9820-39405a57f9f0-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:28 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c 1073741824" returned: 0 in 0.513s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:28 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c
Nov 05 12:15:28 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:28 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-6b209c3b-2c74-49d8-9935-1259a4936d73" returned: 0 in 0.284s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-6b209c3b-2c74-49d8-9935-1259a4936d73" released by "delete_volume" :: held 0.798s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Created reservations ['7addc6c2-913f-4f56-b08d-b55d51f916fe', '6c5df3a6-df65-418e-909e-8ba11b1fb553', '30d5756b-71af-4a8d-955f-0769252fc62a', '7d049119-d77a-4b6a-ba09-a53e26f09983'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:28 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:28 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:28 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" returned: 0 in 0.281s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6b13b5-cb46-4df4-b731-689654db2ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84530a4-1e16-4fa4-ba71-375c576b3d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:28 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Volume volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c (3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c): created successfully
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84530a4-1e16-4fa4-ba71-375c576b3d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (2c78ef9e-1811-4922-973a-672278a30b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-023aeeba-4e8c-4e83-a821-dc80612f7064 tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Acquiring lock "cinder-2c0dba0c-6965-46f1-a090-6fe1799b6477-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Lock "cinder-2c0dba0c-6965-46f1-a090-6fe1799b6477-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:28 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.341s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Acquiring lock "cinder-quobyte-2c0dba0c-6965-46f1-a090-6fe1799b6477" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:28 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Deleted volume successfully.
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Lock "cinder-quobyte-2c0dba0c-6965-46f1-a090-6fe1799b6477" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8b6a3f7-88c8-484b-bbac-16fe58c92db5 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-6b209c3b-2c74-49d8-9935-1259a4936d73-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7490a76-d6ca-422c-894e-e41edeab813e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:28 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477
Nov 05 12:15:29 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (6bac3466-16c0-4213-a98c-f320a131f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01325c4-e010-4a9d-9cfb-2c5864a5e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01325c4-e010-4a9d-9cfb-2c5864a5e7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032984410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec3f064-2d88-42d8-9fb4-f19638acb0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:29Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025e94a9-9e2b-47f4-be9e-ce53d88c913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025e94a9-9e2b-47f4-be9e-ce53d88c913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7229f49-a160-4f6e-95db-25f8aa21d22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7229f49-a160-4f6e-95db-25f8aa21d22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec3f064-2d88-42d8-9fb4-f19638acb0fc', 'volume_name': 'volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e199e2e6-bf8e-4183-ba1f-71c08d623c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e199e2e6-bf8e-4183-ba1f-71c08d623c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3fac5f-68d8-4329-8b46-34f058960763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:29 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Volume aec3f064-2d88-42d8-9fb4-f19638acb0fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc', 'volume_size': 1}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032984410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec3f064-2d88-42d8-9fb4-f19638acb0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:29Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Creating volume aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:29 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc 1073741824
Nov 05 12:15:29 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:29 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477" returned: 0 in 0.435s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477
Nov 05 12:15:29 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:29 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2c0dba0c-6965-46f1-a090-6fe1799b6477" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Lock "cinder-quobyte-2c0dba0c-6965-46f1-a090-6fe1799b6477" released by "delete_volume" :: held 0.772s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Created reservations ['aea0c646-b778-4053-88e5-19c973f7755a', 'bea9d4b7-70cf-4d2a-915e-3007ae35f9bb', '54a1e8cc-1feb-4789-8478-451b6a15f1fc', 'ceb7fea7-4ce3-4b5f-a307-2d39af1c5098'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc 1073741824" returned: 0 in 0.612s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:29 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:29 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:29 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc
Nov 05 12:15:29 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:30 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.374s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Deleted volume successfully.
Nov 05 12:15:30 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc" returned: 0 in 0.386s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de2bfc0b-967e-4933-9208-921420d039f3 tempest-VolumeImageDependencyTests-2055859848 None] Lock "cinder-2c0dba0c-6965-46f1-a090-6fe1799b6477-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3fac5f-68d8-4329-8b46-34f058960763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e944ae-4c13-4d94-94ef-922643daff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:30 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Volume volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc (aec3f064-2d88-42d8-9fb4-f19638acb0fc): created successfully
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e944ae-4c13-4d94-94ef-922643daff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (6bac3466-16c0-4213-a98c-f320a131f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2211c007-ae9f-427c-a114-b3405d9fb815 tempest-ProjectReaderTests-1185429902 None] Created volume successfully.
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Creating offline snapshot d0bbbab9-fbf7-46e7-b4de-a7f3046d437c of volume 3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[47773323-dd79-4aea-af60-94c8cc033d06]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:30 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c
Nov 05 12:15:30 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:30 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" returned: 0 in 0.426s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:30 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c 1G
Nov 05 12:15:30 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:31 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c 1G" returned: 0 in 0.651s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:31 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c
Nov 05 12:15:31 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:31 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" returned: 0 in 0.353s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:31 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c is being set with open permissions: ugo+rw
Nov 05 12:15:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:31 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c
Nov 05 12:15:31 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:32 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" returned: 0 in 0.258s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:32 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.info
Nov 05 12:15:32 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:32 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.info" returned: 0 in 0.317s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:32 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.info is being set with open permissions: ugo+rw
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:32 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.info
Nov 05 12:15:32 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:32 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.info" returned: 0 in 0.244s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.305s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Creating offline snapshot ef998777-edf2-4569-8dac-181abac8b3cb of volume aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c74ac94f-183c-4843-b36d-8da1f42ec66b tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c4c11f-6708-4a07-b5b7-042d759cf172]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-c6975694-907d-467e-868b-a0c0dc0a128b tempest-ProjectAdminTests-408413011 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4715194702148, 'free_capacity_gb': 1773.4715194702148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87317) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 12:15:33 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc
Nov 05 12:15:33 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:33 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:33 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb 1G
Nov 05 12:15:33 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-d0bbbab9-fbf7-46e7-b4de-a7f3046d437c-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Lock "cinder-d0bbbab9-fbf7-46e7-b4de-a7f3046d437c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot d0bbbab9-fbf7-46e7-b4de-a7f3046d437c of volume 3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[95012d35-2ce6-4746-b41f-b78354b63d05]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:33 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb 1G" returned: 0 in 0.497s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:33 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb
Nov 05 12:15:33 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:33 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c
Nov 05 12:15:33 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:34 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb" returned: 0 in 0.344s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:34 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb is being set with open permissions: ugo+rw
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:34 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" returned: 0 in 0.424s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:34 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb
Nov 05 12:15:34 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb28464d-4bc4-4dd7-9164-e09e3bdc2873]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:34 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c
Nov 05 12:15:34 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:34 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb" returned: 0 in 0.305s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:34 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.info
Nov 05 12:15:34 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:34 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" returned: 0 in 0.454s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:34 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c
Nov 05 12:15:34 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:34 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.info" returned: 0 in 0.288s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:34 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.info is being set with open permissions: ugo+rw
Nov 05 12:15:34 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:34 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.info
Nov 05 12:15:34 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:35 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:35 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" returned: 0 in 0.403s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.info" returned: 0 in 0.300s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:35 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c
Nov 05 12:15:35 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8afb7520-3ba7-47bc-ac1a-716542522c21 tempest-ProjectReaderTests-1185429902 None] Create snapshot completed successfully
Nov 05 12:15:35 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c.d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" returned: 0 in 0.265s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-d0bbbab9-fbf7-46e7-b4de-a7f3046d437c" released by "_delete_snapshot" :: held 1.691s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" released by "delete_snapshot" :: held 1.720s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Created reservations ['ca0729aa-7b6b-4f5e-8396-8c1351ecf722', '99ab5edf-46b0-406b-9394-9dd96341e20e', '2a4ab731-4ae0-4f4d-902c-b284be844c38', 'ffe7f801-10fe-41f1-854c-3304dd236523'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:35 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e06893e3-4e39-4a6b-92cb-fa3279386973 tempest-ProjectMemberTests-870165117 None] Lock "cinder-d0bbbab9-fbf7-46e7-b4de-a7f3046d437c-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-ef998777-edf2-4569-8dac-181abac8b3cb-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-ef998777-edf2-4569-8dac-181abac8b3cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-aec3f064-2d88-42d8-9fb4-f19638acb0fc" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Lock "cinder-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-aec3f064-2d88-42d8-9fb4-f19638acb0fc" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-ef998777-edf2-4569-8dac-181abac8b3cb" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-ef998777-edf2-4569-8dac-181abac8b3cb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Deleting offline snapshot ef998777-edf2-4569-8dac-181abac8b3cb of volume aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] snapshot_file for this snap is: volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb42cc-af6c-4b71-9881-0234ff18289a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:35 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e190bb61-cc8b-447f-9dbb-ae29249ebbb5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:36 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb
Nov 05 12:15:36 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:36 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c
Nov 05 12:15:36 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:36 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb" returned: 0 in 0.414s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d382083-3c48-42e0-9839-2c4f074031f5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:36 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" returned: 0 in 0.411s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:36 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c
Nov 05 12:15:36 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:36 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc
Nov 05 12:15:36 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:36 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" returned: 0 in 0.263s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c" released by "delete_volume" :: held 0.757s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Created reservations ['b0404d6e-52fb-494a-9cb7-28cdb84430e5', 'c89a9db4-80eb-469a-aa40-f4831987ff6e', '070009ed-8de9-4bfc-b73e-83a1905454a3', 'b307ebd0-0055-4277-b77d-dede55ad7647'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:36 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc" returned: 0 in 0.428s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:36 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb
Nov 05 12:15:36 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:36 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:36 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:37 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (8cfe7a57-04a7-424b-a00e-6fc4583e98f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4e8a71-5325-45ae-acad-03e5c3c6bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.336s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4e8a71-5325-45ae-acad-03e5c3c6bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130045670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b38fcd-c48b-475b-86ba-563f6da30f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:37Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35dadcd-3030-4580-babe-e4a88da192d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35dadcd-3030-4580-babe-e4a88da192d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e304c81-94d9-4fc8-824b-a5113ea2fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e304c81-94d9-4fc8-824b-a5113ea2fefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b38fcd-c48b-475b-86ba-563f6da30f0d', 'volume_name': 'volume-57b38fcd-c48b-475b-86ba-563f6da30f0d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17fc7e9-c5ba-4fb9-b39b-d69b53804c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17fc7e9-c5ba-4fb9-b39b-d69b53804c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d733a6d0-9119-4bfd-b90b-8a33479d20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Volume 57b38fcd-c48b-475b-86ba-563f6da30f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b38fcd-c48b-475b-86ba-563f6da30f0d', 'volume_size': 1}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130045670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b38fcd-c48b-475b-86ba-563f6da30f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:37Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Creating volume 57b38fcd-c48b-475b-86ba-563f6da30f0d {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb" returned: 0 in 0.527s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:37 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d 1073741824
Nov 05 12:15:37 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-e16d5829-1073-4e49-8261-157a4bd74b36 tempest-ProjectMemberTests-870165117 None] Lock "cinder-3f7ab92c-a16f-45f0-a338-d6f1b58b3a7c-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:37 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb
Nov 05 12:15:37 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:37 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (a642c3e1-4dfe-47d4-b643-54064e9977c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effbde9f-b19a-4765-a11e-1cf69b5fd84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc.ef998777-edf2-4569-8dac-181abac8b3cb" returned: 0 in 0.325s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effbde9f-b19a-4765-a11e-1cf69b5fd84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667971616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe900be-8338-44ce-b75c-0ef1d71e17bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:38Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccab1f33-add6-4ce6-8bac-00c07170dafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccab1f33-add6-4ce6-8bac-00c07170dafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8f3cb2-1119-48e8-b1ee-1abbda23d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8f3cb2-1119-48e8-b1ee-1abbda23d79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe900be-8338-44ce-b75c-0ef1d71e17bf', 'volume_name': 'volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cad124-d95a-4049-a912-af182eb94ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cad124-d95a-4049-a912-af182eb94ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c2940a-cb1b-4c5b-ae09-7fe657ddcd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Volume 4fe900be-8338-44ce-b75c-0ef1d71e17bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf', 'volume_size': 1}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-ef998777-edf2-4569-8dac-181abac8b3cb" released by "_delete_snapshot" :: held 1.866s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-aec3f064-2d88-42d8-9fb4-f19638acb0fc" released by "delete_snapshot" :: held 1.894s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:37 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d 1073741824" returned: 0 in 0.481s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Created reservations ['23626ed7-8aa0-4081-a216-78c01a9594a6', 'ddbc0876-c7d1-4a2d-90f2-6bf3936c5a50', 'b9eb1add-d008-4988-a92f-c7d787e4d213', 'db9f6e43-53f9-4019-9713-f985e74afb3e'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:37 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d
Nov 05 12:15:37 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Delete snapshot completed successfully.
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-422a98fc-90fc-4494-ae46-f8292cf63317 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-ef998777-edf2-4569-8dac-181abac8b3cb-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-aec3f064-2d88-42d8-9fb4-f19638acb0fc-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:37 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Lock "cinder-aec3f064-2d88-42d8-9fb4-f19638acb0fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-aec3f064-2d88-42d8-9fb4-f19638acb0fc" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-aec3f064-2d88-42d8-9fb4-f19638acb0fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f2fb8-dd68-488d-9604-0509a9df6484]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d" returned: 0 in 0.316s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667971616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe900be-8338-44ce-b75c-0ef1d71e17bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:38Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Creating volume 4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:38 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d733a6d0-9119-4bfd-b90b-8a33479d20f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b38fcd-c48b-475b-86ba-563f6da30f0d', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10596abd-5f45-4867-bcba-9da2c591fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:38 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf 1073741824
Nov 05 12:15:38 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Volume volume-57b38fcd-c48b-475b-86ba-563f6da30f0d (57b38fcd-c48b-475b-86ba-563f6da30f0d): created successfully
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10596abd-5f45-4867-bcba-9da2c591fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (8cfe7a57-04a7-424b-a00e-6fc4583e98f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0ed35e15-7a20-4fa3-b510-0a053e05f308 tempest-ProjectReaderTests-1503939641 None] Created volume successfully.
Nov 05 12:15:38 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc
Nov 05 12:15:38 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc
Nov 05 12:15:38 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf 1073741824" returned: 0 in 0.479s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf
Nov 05 12:15:38 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-aec3f064-2d88-42d8-9fb4-f19638acb0fc" returned: 0 in 0.269s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-aec3f064-2d88-42d8-9fb4-f19638acb0fc" released by "delete_volume" :: held 0.749s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Created reservations ['147887ee-26a5-49e9-82e6-beef6a293687', '46659dd2-0147-469c-8ce6-4d85e2f3a172', 'e6dbaaab-ad53-457a-b353-de0562cd50ea', 'f809b7d9-41f4-4405-be4c-3a34b1428a61'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:38 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:38 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:38 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c2940a-cb1b-4c5b-ae09-7fe657ddcd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7b72c4-0e32-45e7-bb20-9032cbf04e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:38 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Volume volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf (4fe900be-8338-44ce-b75c-0ef1d71e17bf): created successfully
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7b72c4-0e32-45e7-bb20-9032cbf04e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:38 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (a642c3e1-4dfe-47d4-b643-54064e9977c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:38 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-084c3ed3-ea8d-4ec6-8056-32ab6b53bf2e tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:15:39 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Deleted volume successfully.
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-37df98e3-a5bf-4eba-9a5d-266a362af2ff tempest-ProjectReaderTests-1185429902 None] Lock "cinder-aec3f064-2d88-42d8-9fb4-f19638acb0fc-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-57b38fcd-c48b-475b-86ba-563f6da30f0d-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Lock "cinder-57b38fcd-c48b-475b-86ba-563f6da30f0d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-quobyte-57b38fcd-c48b-475b-86ba-563f6da30f0d" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-57b38fcd-c48b-475b-86ba-563f6da30f0d" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[a375b18a-a941-4cef-a316-ab5cfd8b5b08]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (689875c8-ce97-4678-8d98-7eedef12d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfe2639-295f-4355-a1af-47ef9ef7a070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:39 devstack sudo[106546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d
Nov 05 12:15:39 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfe2639-295f-4355-a1af-47ef9ef7a070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879421353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4a1dff-1a88-472c-ab5d-9a09108858d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:40Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36cc62a-525d-46a8-885c-fd47e0216957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36cc62a-525d-46a8-885c-fd47e0216957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3df2f3-b6c0-4920-96d6-b3fcd9788c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3df2f3-b6c0-4920-96d6-b3fcd9788c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4a1dff-1a88-472c-ab5d-9a09108858d9', 'volume_name': 'volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85000ad4-d35b-448e-9b3b-1485f1688152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85000ad4-d35b-448e-9b3b-1485f1688152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fd975c-6da6-4363-8e2d-49ae2feed72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:39 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Volume 5c4a1dff-1a88-472c-ab5d-9a09108858d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9', 'volume_size': 1}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879421353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4a1dff-1a88-472c-ab5d-9a09108858d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8025e8fde2ad49ddb3405881512c89cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:40Z,use_quota=True,user_id='28abb2b7be384974a5f627ff78cbf12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Creating volume 5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:39 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:39 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 1073741824
Nov 05 12:15:39 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:39 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d" returned: 0 in 0.406s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:39 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d
Nov 05 12:15:39 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:40 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-57b38fcd-c48b-475b-86ba-563f6da30f0d" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 1073741824" returned: 0 in 0.485s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-57b38fcd-c48b-475b-86ba-563f6da30f0d" released by "delete_volume" :: held 0.722s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:40 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9
Nov 05 12:15:40 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Created reservations ['d2a07c8c-84d3-4043-a394-02ceb8dd67dc', '09c6989c-4824-4553-83ac-48524e4bf673', '60fea297-c92e-4eda-9286-85bcb0ca827f', 'f2870502-1980-481e-8836-d45a1dc7fdf9'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:40 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:40 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:40 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9" returned: 0 in 0.263s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.696s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Creating offline snapshot 769cbbb3-5791-4c75-acf4-29259e58582b of volume 4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fd975c-6da6-4363-8e2d-49ae2feed72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965c98df-501c-4160-b280-dded796a1abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f809885-7dfb-4f3f-be8d-212f499c3ffc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:40 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Volume volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 (5c4a1dff-1a88-472c-ab5d-9a09108858d9): created successfully
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965c98df-501c-4160-b280-dded796a1abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Flow 'volume_create_manager' (689875c8-ce97-4678-8d98-7eedef12d93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:40 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.277s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-4d446279-d095-4975-9745-046c2712c057 tempest-ProjectReaderTests-1185429902 None] Created volume successfully.
Nov 05 12:15:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Deleted volume successfully.
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bf57f14d-b92a-4be1-932e-1348422cbc3f tempest-ProjectReaderTests-1503939641 None] Lock "cinder-57b38fcd-c48b-475b-86ba-563f6da30f0d-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:40 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf
Nov 05 12:15:40 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:40 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf" returned: 0 in 0.389s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:41 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b 1G
Nov 05 12:15:41 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (9ff18336-323d-48fe-b98f-bb40b58da494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b00b19a-1d14-410e-aa0f-4fe6f4fdd346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b00b19a-1d14-410e-aa0f-4fe6f4fdd346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80016421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493bd06d-a95d-4ac9-9c0d-0726dc8f0575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:41Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6db7b4-eeb7-40bf-aeab-02a04b7f9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6db7b4-eeb7-40bf-aeab-02a04b7f9587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd744fb-7cca-483a-a3cd-ba09024bd87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd744fb-7cca-483a-a3cd-ba09024bd87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493bd06d-a95d-4ac9-9c0d-0726dc8f0575', 'volume_name': 'volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ada6536-c71f-4ef2-9ac0-6508941c9088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ada6536-c71f-4ef2-9ac0-6508941c9088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7020125-c481-4b5a-8883-0f1d3e943621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:41 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Volume 493bd06d-a95d-4ac9-9c0d-0726dc8f0575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575', 'volume_size': 1}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:41 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b 1G" returned: 0 in 0.434s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:41 devstack sudo[106576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b
Nov 05 12:15:41 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:41 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b" returned: 0 in 0.293s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:41 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b is being set with open permissions: ugo+rw
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:41 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b
Nov 05 12:15:41 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:41 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b" returned: 0 in 0.241s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.info
Nov 05 12:15:42 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.info" returned: 0 in 0.255s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.info is being set with open permissions: ugo+rw
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.info
Nov 05 12:15:42 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.info" returned: 0 in 0.232s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80016421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493bd06d-a95d-4ac9-9c0d-0726dc8f0575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:41Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Creating volume 493bd06d-a95d-4ac9-9c0d-0726dc8f0575 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:42 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack sudo[106590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575 1073741824
Nov 05 12:15:42 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6268982f-949b-46c3-923e-ae60847519d4 tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:15:42 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575 1073741824" returned: 0 in 0.434s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-769cbbb3-5791-4c75-acf4-29259e58582b-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:43 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575
Nov 05 12:15:43 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Lock "cinder-769cbbb3-5791-4c75-acf4-29259e58582b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-4fe900be-8338-44ce-b75c-0ef1d71e17bf" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-4fe900be-8338-44ce-b75c-0ef1d71e17bf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-769cbbb3-5791-4c75-acf4-29259e58582b" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-769cbbb3-5791-4c75-acf4-29259e58582b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot 769cbbb3-5791-4c75-acf4-29259e58582b of volume 4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6719f041-00ca-41db-ac68-6e75d62b6fe1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:43 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b
Nov 05 12:15:43 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:43 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.359s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7020125-c481-4b5a-8883-0f1d3e943621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032b18d3-d9ce-433f-957e-6e1c2a7b6471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Creating offline snapshot c6e6f75a-794e-4282-8a1c-5d638b2ccfbb of volume 5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:43 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Volume volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575 (493bd06d-a95d-4ac9-9c0d-0726dc8f0575): created successfully
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032b18d3-d9ce-433f-957e-6e1c2a7b6471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (9ff18336-323d-48fe-b98f-bb40b58da494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eb0321-5c1f-464c-9c2f-cdbd50ef934f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:43 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-49f32856-e711-4d08-b552-12da4794e5a2 tempest-ProjectReaderTests-1503939641 None] Created volume successfully.
Nov 05 12:15:43 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9
Nov 05 12:15:43 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:43 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b" returned: 0 in 0.360s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be69fd-ec1f-4776-baa5-44207b539e4c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:43 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf
Nov 05 12:15:43 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:43 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9" returned: 0 in 0.393s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:43 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb 1G
Nov 05 12:15:43 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:43 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf" returned: 0 in 0.370s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:43 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b
Nov 05 12:15:43 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:44 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb 1G" returned: 0 in 0.440s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:44 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb
Nov 05 12:15:44 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:44 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b" returned: 0 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:44 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b
Nov 05 12:15:44 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-493bd06d-a95d-4ac9-9c0d-0726dc8f0575-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-493bd06d-a95d-4ac9-9c0d-0726dc8f0575-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-quobyte-493bd06d-a95d-4ac9-9c0d-0726dc8f0575" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-493bd06d-a95d-4ac9-9c0d-0726dc8f0575" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a64f458-d5db-41f5-9317-f8ef5dcf330b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:44 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" returned: 0 in 0.357s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:44 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb is being set with open permissions: ugo+rw
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:44 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb
Nov 05 12:15:44 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:44 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575
Nov 05 12:15:44 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:44 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf.769cbbb3-5791-4c75-acf4-29259e58582b" returned: 0 in 0.331s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-769cbbb3-5791-4c75-acf4-29259e58582b" released by "_delete_snapshot" :: held 1.594s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-4fe900be-8338-44ce-b75c-0ef1d71e17bf" released by "delete_snapshot" :: held 1.616s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Created reservations ['652559f6-4b19-493a-9752-c5a4b3d060ad', '6f4ac80e-bfb7-48e5-b601-cb2739a33a05', '740ff3ed-ebb3-48fe-830a-61f64d560898', '7b56ec09-9008-441c-a70a-ca005d418898'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:44 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:44 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-91d02f4a-735c-4422-8c64-dd34c696f2af tempest-ProjectMemberTests-870165117 None] Lock "cinder-769cbbb3-5791-4c75-acf4-29259e58582b-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:44 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.info
Nov 05 12:15:44 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:44 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575" returned: 0 in 0.430s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:44 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:44 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575
Nov 05 12:15:44 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.info" returned: 0 in 0.254s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.info is being set with open permissions: ugo+rw
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:45 devstack sudo[106646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.info
Nov 05 12:15:45 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-493bd06d-a95d-4ac9-9c0d-0726dc8f0575" returned: 0 in 0.287s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-493bd06d-a95d-4ac9-9c0d-0726dc8f0575" released by "delete_volume" :: held 0.770s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-4fe900be-8338-44ce-b75c-0ef1d71e17bf-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Created reservations ['e4c17220-101a-4d66-9400-568495dc9c74', '1b19cb85-6d5f-47f5-b296-ae39e0eddb20', 'b74e2e62-c2f2-4adc-8bc2-6cc70d23c396', 'e18bfef9-4e5e-44e2-aff5-54d3f45a1172'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Lock "cinder-4fe900be-8338-44ce-b75c-0ef1d71e17bf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-4fe900be-8338-44ce-b75c-0ef1d71e17bf" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:45 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.info" returned: 0 in 0.299s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-4fe900be-8338-44ce-b75c-0ef1d71e17bf" acquired by "delete_volume" :: waited 0.053s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[370f93c5-829e-4b11-83a1-c990275b3d27]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c98b527e-7f5d-45ff-b967-aae11fd77288 tempest-ProjectReaderTests-1185429902 None] Create snapshot completed successfully
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:45 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:45 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf
Nov 05 12:15:45 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.342s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:45 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Deleted volume successfully.
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-d8f644c5-49fb-408f-bffc-2e3fa06e7442 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-493bd06d-a95d-4ac9-9c0d-0726dc8f0575-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:45 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:45 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf
Nov 05 12:15:45 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:45 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (98bfeaef-114e-4d6c-a5d5-6ff32e215b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3a1627-967a-4ec9-8203-b47e75254764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3a1627-967a-4ec9-8203-b47e75254764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187332201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09de62d-e289-446e-8901-54d5be562f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:46Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f0065d-858c-45f7-b8ca-6f63c650f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f0065d-858c-45f7-b8ca-6f63c650f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10c8f77-337b-450e-85e6-207bca1ac193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10c8f77-337b-450e-85e6-207bca1ac193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09de62d-e289-446e-8901-54d5be562f1c', 'volume_name': 'volume-b09de62d-e289-446e-8901-54d5be562f1c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15a7e74-e51d-49c8-a0ee-8e253cf13645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15a7e74-e51d-49c8-a0ee-8e253cf13645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f51694c-9565-4924-9987-87675ea685b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:46 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Volume b09de62d-e289-446e-8901-54d5be562f1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09de62d-e289-446e-8901-54d5be562f1c', 'volume_size': 1}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187332201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09de62d-e289-446e-8901-54d5be562f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:46Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Creating volume b09de62d-e289-446e-8901-54d5be562f1c {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:46 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-c6e6f75a-794e-4282-8a1c-5d638b2ccfbb-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:46 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c 1073741824
Nov 05 12:15:46 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-c6e6f75a-794e-4282-8a1c-5d638b2ccfbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-5c4a1dff-1a88-472c-ab5d-9a09108858d9" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:46 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-4fe900be-8338-44ce-b75c-0ef1d71e17bf" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-5c4a1dff-1a88-472c-ab5d-9a09108858d9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-4fe900be-8338-44ce-b75c-0ef1d71e17bf" released by "delete_volume" :: held 0.799s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Deleting offline snapshot c6e6f75a-794e-4282-8a1c-5d638b2ccfbb of volume 5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] snapshot_file for this snap is: volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd18118-ca6b-4cd9-938c-7f3b70ebcd7b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Created reservations ['7d859e4f-b245-43f3-8f85-d2b87195eafb', 'efa7bb4c-4d10-4c59-90f6-4815e7e02b07', 'aa5b2264-4db5-4d9a-831f-fdcab3ba1725', 'c4c71eb5-e189-4dc9-9283-a997943cceb5'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:46 devstack sudo[106663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb
Nov 05 12:15:46 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:46 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:46 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:46 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c 1073741824" returned: 0 in 0.591s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:46 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.370s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:46 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:15:46 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c
Nov 05 12:15:46 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:46 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" returned: 0 in 0.536s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa858d74-431c-43eb-9e82-df1272d3f0b8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-ba4dac3e-d519-458f-8e25-712c3c27a725 tempest-ProjectMemberTests-870165117 None] Lock "cinder-4fe900be-8338-44ce-b75c-0ef1d71e17bf-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:46 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9
Nov 05 12:15:46 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:46 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (7fec0319-c8e3-42cb-bc46-4c2493b8aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec9527-5aa6-4770-b600-b11f2e0f4a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec9527-5aa6-4770-b600-b11f2e0f4a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514107238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718d2173-a07e-4f0a-9d50-858b8824757c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:47Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993d18b4-6c38-4487-8d27-cd43988f0050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993d18b4-6c38-4487-8d27-cd43988f0050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ebcfa8-db5f-498b-9724-8244679c06b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ebcfa8-db5f-498b-9724-8244679c06b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718d2173-a07e-4f0a-9d50-858b8824757c', 'volume_name': 'volume-718d2173-a07e-4f0a-9d50-858b8824757c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd192ac-8afb-487a-aaa1-a75ed947110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd192ac-8afb-487a-aaa1-a75ed947110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3551c53c-9715-44c1-8ab2-6b7311d777ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:47 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Volume 718d2173-a07e-4f0a-9d50-858b8824757c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718d2173-a07e-4f0a-9d50-858b8824757c', 'volume_size': 1}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c" returned: 0 in 0.351s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514107238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718d2173-a07e-4f0a-9d50-858b8824757c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:47Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Creating volume 718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:47 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f51694c-9565-4924-9987-87675ea685b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09de62d-e289-446e-8901-54d5be562f1c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f25a15-4ba5-4ac2-8271-d75bf98bf8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:47 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c 1073741824
Nov 05 12:15:47 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:47 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Volume volume-b09de62d-e289-446e-8901-54d5be562f1c (b09de62d-e289-446e-8901-54d5be562f1c): created successfully
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f25a15-4ba5-4ac2-8271-d75bf98bf8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (98bfeaef-114e-4d6c-a5d5-6ff32e215b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f7fd178d-9341-4792-be87-7edb72c4ff11 tempest-ProjectReaderTests-1503939641 None] Created volume successfully.
Nov 05 12:15:47 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9" returned: 0 in 0.435s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:47 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb
Nov 05 12:15:47 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:47 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c 1073741824" returned: 0 in 0.483s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:47 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c
Nov 05 12:15:47 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:47 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:47 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb
Nov 05 12:15:47 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:47 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c" returned: 0 in 0.276s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3551c53c-9715-44c1-8ab2-6b7311d777ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718d2173-a07e-4f0a-9d50-858b8824757c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe076fe-30af-490e-a537-6329b73800aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:47 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Volume volume-718d2173-a07e-4f0a-9d50-858b8824757c (718d2173-a07e-4f0a-9d50-858b8824757c): created successfully
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe076fe-30af-490e-a537-6329b73800aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (7fec0319-c8e3-42cb-bc46-4c2493b8aa79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:47 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9.c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" returned: 0 in 0.263s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:47 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5c430b84-540f-455b-b623-9d2ad473cabc tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-c6e6f75a-794e-4282-8a1c-5d638b2ccfbb" released by "_delete_snapshot" :: held 1.784s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:47 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-5c4a1dff-1a88-472c-ab5d-9a09108858d9" released by "delete_snapshot" :: held 1.819s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Created reservations ['9fb314ad-cf8c-4086-94af-82d85791814e', '498ac572-491c-4993-96f6-f2157fb56f17', '9efb679c-3304-4522-a3c4-cb1959fac7f7', 'c3f5837a-1032-4335-a476-a28293a97282'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:48 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Delete snapshot completed successfully.
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f6e5aaf9-dad4-41a9-9f1f-9cc8bf687ca2 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-c6e6f75a-794e-4282-8a1c-5d638b2ccfbb-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-b09de62d-e289-446e-8901-54d5be562f1c-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-b09de62d-e289-446e-8901-54d5be562f1c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-quobyte-b09de62d-e289-446e-8901-54d5be562f1c" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-b09de62d-e289-446e-8901-54d5be562f1c" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3586fce0-6ba8-47fc-bc43-325e4a99ffdf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-5c4a1dff-1a88-472c-ab5d-9a09108858d9-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-5c4a1dff-1a88-472c-ab5d-9a09108858d9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "cinder-quobyte-5c4a1dff-1a88-472c-ab5d-9a09108858d9" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:48 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c
Nov 05 12:15:48 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-5c4a1dff-1a88-472c-ab5d-9a09108858d9" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce037bd-ee83-49de-98ef-a6cb74d558ed]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:48 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9
Nov 05 12:15:48 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:48 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c" returned: 0 in 0.374s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:48 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c
Nov 05 12:15:48 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:48 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9" returned: 0 in 0.377s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:48 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9
Nov 05 12:15:48 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:48 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-b09de62d-e289-446e-8901-54d5be562f1c" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-b09de62d-e289-446e-8901-54d5be562f1c" released by "delete_volume" :: held 0.709s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:48 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Created reservations ['7f25e70c-7a7a-49a8-813b-4f3e70c8f05e', '003e486a-3f9c-4908-b34d-290fe832cb45', '97919ec4-bab2-427e-9e2e-ff2a202d2321', '59385b11-8b85-48d6-836c-3d2c6c01140a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:49 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-5c4a1dff-1a88-472c-ab5d-9a09108858d9" returned: 0 in 0.259s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-quobyte-5c4a1dff-1a88-472c-ab5d-9a09108858d9" released by "delete_volume" :: held 0.706s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:49 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:49 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Created reservations ['c1366cb7-0bc2-416a-83a1-3835b440ccb4', 'c076bf75-540e-48fd-9f11-069c4f7425b6', '5ca808ac-abcf-45e2-b91b-f100161174f2', '58ac698d-746a-4b07-8b00-653b13841ed0'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:49 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:49 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Creating offline snapshot 29639e83-07e8-4150-92d0-8bcc9c5e148e of volume 718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[338604fe-dc9e-4bf7-957f-51d47debbec2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:49 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.372s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Deleted volume successfully.
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8dc6af90-0a4b-4f56-ab7c-7d2d2cfb7897 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-b09de62d-e289-446e-8901-54d5be562f1c-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:49 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c
Nov 05 12:15:49 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:49 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.318s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:49 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Deleted volume successfully.
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6c12ad1f-a933-4a15-8d52-1549dc6181e3 tempest-ProjectReaderTests-1185429902 None] Lock "cinder-5c4a1dff-1a88-472c-ab5d-9a09108858d9-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:49 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c" returned: 0 in 0.486s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:49 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e 1G
Nov 05 12:15:49 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (3d0ba937-d571-4371-9a47-f4cf24343d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a84cdf-853c-488d-8fa0-701235ebc6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a84cdf-853c-488d-8fa0-701235ebc6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515754753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb77de3a-c244-4eac-bede-53d9cb85c452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:50Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b8f40e-d7f0-4c0e-a66d-f7295678e00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b8f40e-d7f0-4c0e-a66d-f7295678e00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79e4b5e-df31-423e-ad21-8d2b9fddcfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79e4b5e-df31-423e-ad21-8d2b9fddcfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb77de3a-c244-4eac-bede-53d9cb85c452', 'volume_name': 'volume-fb77de3a-c244-4eac-bede-53d9cb85c452', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:49 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2cbf81-2758-43de-bb5f-6566a1f909bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2cbf81-2758-43de-bb5f-6566a1f909bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe54b69-06d0-49c8-840f-adbe15a8b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:50 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Volume fb77de3a-c244-4eac-bede-53d9cb85c452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb77de3a-c244-4eac-bede-53d9cb85c452', 'volume_size': 1}
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:50 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e 1G" returned: 0 in 0.468s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718d2173-a07e-4f0a-9d50-858b8824757c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:50 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718d2173-a07e-4f0a-9d50-858b8824757c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e
Nov 05 12:15:50 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:50 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718d2173-a07e-4f0a-9d50-858b8824757c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e" returned: 0 in 0.328s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:50 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e is being set with open permissions: ugo+rw
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:50 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e
Nov 05 12:15:50 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:50 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e" returned: 0 in 0.262s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:50 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.info
Nov 05 12:15:50 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:51 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.info" returned: 0 in 0.283s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:51 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.info is being set with open permissions: ugo+rw
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:51 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.info
Nov 05 12:15:51 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:51 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.info" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515754753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb77de3a-c244-4eac-bede-53d9cb85c452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cfb5881c4a46a2a8a11046731802d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:50Z,use_quota=True,user_id='70b8129dcfc74bd9b39d6572079375e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Creating volume fb77de3a-c244-4eac-bede-53d9cb85c452 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:51 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:51 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452 1073741824
Nov 05 12:15:51 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:51 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f1ae5da5-0dc1-4f75-907d-1efc9ee8d6c5 tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:15:52 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452 1073741824" returned: 0 in 0.476s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:52 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452
Nov 05 12:15:52 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:52 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452" returned: 0 in 0.261s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe54b69-06d0-49c8-840f-adbe15a8b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb77de3a-c244-4eac-bede-53d9cb85c452', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee188f39-18e9-4435-8598-aeca8fa5556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:52 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Volume volume-fb77de3a-c244-4eac-bede-53d9cb85c452 (fb77de3a-c244-4eac-bede-53d9cb85c452): created successfully
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee188f39-18e9-4435-8598-aeca8fa5556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Flow 'volume_create_manager' (3d0ba937-d571-4371-9a47-f4cf24343d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-2e1e3255-ffe6-464d-9532-fbdc557abdf0 tempest-ProjectReaderTests-1503939641 None] Created volume successfully.
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-29639e83-07e8-4150-92d0-8bcc9c5e148e-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Lock "cinder-29639e83-07e8-4150-92d0-8bcc9c5e148e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-718d2173-a07e-4f0a-9d50-858b8824757c" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-718d2173-a07e-4f0a-9d50-858b8824757c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-29639e83-07e8-4150-92d0-8bcc9c5e148e" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-29639e83-07e8-4150-92d0-8bcc9c5e148e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot 29639e83-07e8-4150-92d0-8bcc9c5e148e of volume 718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3766a480-3389-48b4-8d4a-379e54b6e990]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:52 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e
Nov 05 12:15:52 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:52 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e" returned: 0 in 0.391s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-718d2173-a07e-4f0a-9d50-858b8824757c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9813bcf4-dcaf-4b8e-8a30-5904b22642f1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-fb77de3a-c244-4eac-bede-53d9cb85c452-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-fb77de3a-c244-4eac-bede-53d9cb85c452-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:53 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c
Nov 05 12:15:53 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "cinder-quobyte-fb77de3a-c244-4eac-bede-53d9cb85c452" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-fb77de3a-c244-4eac-bede-53d9cb85c452" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a072f3-073c-437f-ba8f-6914f35504b9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:53 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452
Nov 05 12:15:53 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:53 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c" returned: 0 in 0.431s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:53 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e
Nov 05 12:15:53 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:53 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452" returned: 0 in 0.456s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:53 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452
Nov 05 12:15:53 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:53 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e" returned: 0 in 0.373s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:53 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e
Nov 05 12:15:53 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:53 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-fb77de3a-c244-4eac-bede-53d9cb85c452" returned: 0 in 0.280s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-quobyte-fb77de3a-c244-4eac-bede-53d9cb85c452" released by "delete_volume" :: held 0.795s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Created reservations ['afad3424-3fa6-410b-806d-a08994630821', '8fb17696-4d8e-4dd7-adea-8b3dd94bb1dd', '9e1aafb0-fff9-4cf3-8abf-c122261dee91', '1a5bca96-7164-465a-aee0-86d7f6f776b5'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:54 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c.29639e83-07e8-4150-92d0-8bcc9c5e148e" returned: 0 in 0.278s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:54 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:54 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-29639e83-07e8-4150-92d0-8bcc9c5e148e" released by "_delete_snapshot" :: held 1.603s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-718d2173-a07e-4f0a-9d50-858b8824757c" released by "delete_snapshot" :: held 1.627s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Created reservations ['86cc5241-f3da-4397-ae84-58f7feebc80f', '1a0a95b4-8548-45d0-84b7-0521f659eb15', '019ca292-69be-4463-af53-ff4f417741bb', '6bd68f1b-a96e-4131-9f59-69d103564f2a'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-030c53ea-9bbc-4e23-85a7-b64f23e67579 tempest-ProjectMemberTests-870165117 None] Lock "cinder-29639e83-07e8-4150-92d0-8bcc9c5e148e-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:54 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.261s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Deleted volume successfully.
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-270d7008-397f-4443-929e-5687f0d98030 tempest-ProjectReaderTests-1503939641 None] Lock "cinder-fb77de3a-c244-4eac-bede-53d9cb85c452-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-718d2173-a07e-4f0a-9d50-858b8824757c-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Lock "cinder-718d2173-a07e-4f0a-9d50-858b8824757c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-718d2173-a07e-4f0a-9d50-858b8824757c" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-718d2173-a07e-4f0a-9d50-858b8824757c" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb1590f-7a6a-4ce3-acb9-5d328df58c20]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:54 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c
Nov 05 12:15:54 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:55 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c" returned: 0 in 0.441s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:55 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c
Nov 05 12:15:55 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:55 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-718d2173-a07e-4f0a-9d50-858b8824757c" returned: 0 in 0.317s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-718d2173-a07e-4f0a-9d50-858b8824757c" released by "delete_volume" :: held 0.836s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Created reservations ['5b8dac8c-d4e8-47ac-a854-cd27192f9331', 'df1504f5-0c56-40ad-bcd7-1fceb7dbcfff', 'e7ceca07-4c3f-48b0-82ce-c039f63135a3', 'b9fba462-31ae-447a-9238-97bac7dd03ad'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:55 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:15:55 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:56 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.344s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:15:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-5ef05f7d-c4d0-41ce-9c37-13f4c71de841 tempest-ProjectMemberTests-870165117 None] Lock "cinder-718d2173-a07e-4f0a-9d50-858b8824757c-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (1c861216-e71c-4dc2-8c5b-99c1a283b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bd8954-6c64-49bf-87ef-0e69ae656aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bd8954-6c64-49bf-87ef-0e69ae656aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398132391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33717eae-bbf4-40fc-9813-4feec18537db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:56Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e8e8df-36aa-4dd0-a862-e3bdc87670a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e8e8df-36aa-4dd0-a862-e3bdc87670a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3136cfeb-5b1a-4ec1-a395-c0f1a4c80da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3136cfeb-5b1a-4ec1-a395-c0f1a4c80da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33717eae-bbf4-40fc-9813-4feec18537db', 'volume_name': 'volume-33717eae-bbf4-40fc-9813-4feec18537db', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931f08f4-71dc-465b-bc1a-5ac07b529f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931f08f4-71dc-465b-bc1a-5ac07b529f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479502ae-1370-4f60-8252-037264890f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:56 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Volume 33717eae-bbf4-40fc-9813-4feec18537db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33717eae-bbf4-40fc-9813-4feec18537db', 'volume_size': 1}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398132391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33717eae-bbf4-40fc-9813-4feec18537db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:15:56Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Creating volume 33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:15:56 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:15:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:56 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db 1073741824
Nov 05 12:15:56 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:57 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db 1073741824" returned: 0 in 0.406s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:57 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db
Nov 05 12:15:57 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:57 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479502ae-1370-4f60-8252-037264890f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33717eae-bbf4-40fc-9813-4feec18537db', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626194b9-04d3-4111-8ad4-9e2b6a917d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:15:57 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Volume volume-33717eae-bbf4-40fc-9813-4feec18537db (33717eae-bbf4-40fc-9813-4feec18537db): created successfully
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626194b9-04d3-4111-8ad4-9e2b6a917d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (1c861216-e71c-4dc2-8c5b-99c1a283b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:15:57 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-a5248374-44cd-460a-9f04-a30edc1a54f8 tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Creating offline snapshot 04a316b5-e912-4c04-bab3-17fd5bf9fcf6 of volume 33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36853ee-441c-4107-b9ef-2157076b8f71]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:15:57 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:57 devstack sudo[106809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db
Nov 05 12:15:57 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:58 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db" returned: 0 in 0.385s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:58 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 1G
Nov 05 12:15:58 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:58 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 1G" returned: 0 in 0.477s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33717eae-bbf4-40fc-9813-4feec18537db -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:58 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33717eae-bbf4-40fc-9813-4feec18537db -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6
Nov 05 12:15:58 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:58 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33717eae-bbf4-40fc-9813-4feec18537db -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6" returned: 0 in 0.353s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:58 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 is being set with open permissions: ugo+rw
Nov 05 12:15:58 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:59 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6
Nov 05 12:15:59 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:59 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6" returned: 0 in 0.270s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:59 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.info
Nov 05 12:15:59 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:59 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.info" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:59 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.info is being set with open permissions: ugo+rw
Nov 05 12:15:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:15:59 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.info
Nov 05 12:15:59 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:15:59 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Nov 05 12:15:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.info" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:15:59 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:15:59 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-1552e0b0-e563-4b35-bb7d-cf45598a0d6e tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:16:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-04a316b5-e912-4c04-bab3-17fd5bf9fcf6-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Lock "cinder-04a316b5-e912-4c04-bab3-17fd5bf9fcf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-33717eae-bbf4-40fc-9813-4feec18537db" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-33717eae-bbf4-40fc-9813-4feec18537db" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-04a316b5-e912-4c04-bab3-17fd5bf9fcf6" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:00 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-04a316b5-e912-4c04-bab3-17fd5bf9fcf6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:00 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot 04a316b5-e912-4c04-bab3-17fd5bf9fcf6 of volume 33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a6a9f-9c46-45a7-ae6a-9b7b7f4b50c9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:01 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6
Nov 05 12:16:01 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:01 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6" returned: 0 in 0.378s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33717eae-bbf4-40fc-9813-4feec18537db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d078d4f2-0006-4b38-a39b-3cf51ff55979]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:01 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db
Nov 05 12:16:01 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:01 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db" returned: 0 in 0.381s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:01 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:01 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6
Nov 05 12:16:01 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:02 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6" returned: 0 in 0.374s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:02 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6
Nov 05 12:16:02 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:02 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:02 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db.04a316b5-e912-4c04-bab3-17fd5bf9fcf6" returned: 0 in 0.258s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-04a316b5-e912-4c04-bab3-17fd5bf9fcf6" released by "_delete_snapshot" :: held 1.517s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-33717eae-bbf4-40fc-9813-4feec18537db" released by "delete_snapshot" :: held 1.544s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:02 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Created reservations ['cb078826-f7c2-4c29-959a-3204d25df3a0', 'bbd40aa1-3a15-41ed-a518-23e90c9adc16', '5240c2be-fbdd-4673-af8c-4004d403ed1e', 'e23a68fb-aa66-49ed-b738-95f9fb141520'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:02 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:16:02 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-392db85f-47ee-4138-9b9b-53319d8f9db7 tempest-ProjectMemberTests-870165117 None] Lock "cinder-04a316b5-e912-4c04-bab3-17fd5bf9fcf6-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-33717eae-bbf4-40fc-9813-4feec18537db-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Lock "cinder-33717eae-bbf4-40fc-9813-4feec18537db-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-33717eae-bbf4-40fc-9813-4feec18537db" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-33717eae-bbf4-40fc-9813-4feec18537db" acquired by "delete_volume" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b893a-61f1-4a6c-aab2-67a2a6929a3e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:03 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db
Nov 05 12:16:03 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:03 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db" returned: 0 in 0.383s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:03 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db
Nov 05 12:16:03 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:03 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-33717eae-bbf4-40fc-9813-4feec18537db" returned: 0 in 0.253s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-33717eae-bbf4-40fc-9813-4feec18537db" released by "delete_volume" :: held 0.717s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:03 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Created reservations ['4f866150-d5ae-462f-9ca6-d3859df77e8f', '44eedff6-b31b-4d7d-9f70-1762a4062df2', 'ea0ea2a8-3185-47a8-b10b-34f3a1b5431f', 'c0f198e2-b1ed-4d7f-a3f6-dc4f2e5bc1c7'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:04 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:04 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:04 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.272s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:04 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-85adf7af-af14-4a6d-9df1-d41a39bfbd84 tempest-ProjectMemberTests-870165117 None] Lock "cinder-33717eae-bbf4-40fc-9813-4feec18537db-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (2fe4c2ef-bf81-4083-bdd8-24351a4b95fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ecc7a8-50cd-41f1-8c0d-0b4f757ce276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ecc7a8-50cd-41f1-8c0d-0b4f757ce276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-953208520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d0d56f-0a60-470c-a1ec-8f205e578742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:05Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86fe7c6-3493-49b7-b121-1446909d2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86fe7c6-3493-49b7-b121-1446909d2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4338dbfe-48d8-4038-b536-05752aea8822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4338dbfe-48d8-4038-b536-05752aea8822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d0d56f-0a60-470c-a1ec-8f205e578742', 'volume_name': 'volume-98d0d56f-0a60-470c-a1ec-8f205e578742', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6234ecc-b396-473b-943f-c47428117789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6234ecc-b396-473b-943f-c47428117789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a249cc95-ac96-4bdc-886d-8b471f7488f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:04 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Volume 98d0d56f-0a60-470c-a1ec-8f205e578742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d0d56f-0a60-470c-a1ec-8f205e578742', 'volume_size': 1}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-953208520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d0d56f-0a60-470c-a1ec-8f205e578742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:05Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Creating volume 98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:16:04 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:16:04 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:04 devstack sudo[106867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 1073741824
Nov 05 12:16:04 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:05 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 1073741824" returned: 0 in 0.492s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:05 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742
Nov 05 12:16:05 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:05 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742" returned: 0 in 0.266s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a249cc95-ac96-4bdc-886d-8b471f7488f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d0d56f-0a60-470c-a1ec-8f205e578742', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221a8131-ea80-48d7-aebd-f778ba4e82e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:05 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Volume volume-98d0d56f-0a60-470c-a1ec-8f205e578742 (98d0d56f-0a60-470c-a1ec-8f205e578742): created successfully
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221a8131-ea80-48d7-aebd-f778ba4e82e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:05 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (2fe4c2ef-bf81-4083-bdd8-24351a4b95fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:05 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-003537a0-d0fa-4842-9b48-ed2ad5f38d71 tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Creating offline snapshot ba6d74e6-6786-4fdb-bc7c-263414c0d50d of volume 98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cea5cd2-2b90-4495-93f8-e63ba31d29a1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:07 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742
Nov 05 12:16:07 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:07 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742" returned: 0 in 0.367s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:07 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d 1G
Nov 05 12:16:07 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:07 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d 1G" returned: 0 in 0.467s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:07 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d0d56f-0a60-470c-a1ec-8f205e578742 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:07 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d0d56f-0a60-470c-a1ec-8f205e578742 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d
Nov 05 12:16:07 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:08 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d0d56f-0a60-470c-a1ec-8f205e578742 -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d" returned: 0 in 0.326s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:08 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d is being set with open permissions: ugo+rw
Nov 05 12:16:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:08 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d
Nov 05 12:16:08 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:08 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d" returned: 0 in 0.296s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:08 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.info
Nov 05 12:16:08 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:08 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.info" returned: 0 in 0.282s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:08 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.info is being set with open permissions: ugo+rw
Nov 05 12:16:08 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:08 devstack sudo[106898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.info
Nov 05 12:16:08 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:09 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.info" returned: 0 in 0.270s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:09 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:09 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-31a3bbd4-bae1-47e4-a60d-4071521b2c59 tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-ba6d74e6-6786-4fdb-bc7c-263414c0d50d-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Lock "cinder-ba6d74e6-6786-4fdb-bc7c-263414c0d50d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-98d0d56f-0a60-470c-a1ec-8f205e578742" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-98d0d56f-0a60-470c-a1ec-8f205e578742" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-ba6d74e6-6786-4fdb-bc7c-263414c0d50d" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-ba6d74e6-6786-4fdb-bc7c-263414c0d50d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot ba6d74e6-6786-4fdb-bc7c-263414c0d50d of volume 98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3040f6-080a-4750-b171-940fed076cbf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:10 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d
Nov 05 12:16:10 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:10 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d" returned: 0 in 0.392s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98d0d56f-0a60-470c-a1ec-8f205e578742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc426df-1b12-4409-9753-7b1c4809f9b6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:10 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:10 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742
Nov 05 12:16:10 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:11 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742" returned: 0 in 0.388s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:11 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d
Nov 05 12:16:11 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:11 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d" returned: 0 in 0.355s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:11 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d
Nov 05 12:16:11 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:11 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742.ba6d74e6-6786-4fdb-bc7c-263414c0d50d" returned: 0 in 0.247s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-ba6d74e6-6786-4fdb-bc7c-263414c0d50d" released by "_delete_snapshot" :: held 1.503s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-98d0d56f-0a60-470c-a1ec-8f205e578742" released by "delete_snapshot" :: held 1.532s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Created reservations ['e4a72e19-589f-4dd0-a15c-84e1c73c892d', 'ea582a6e-a953-434b-a7bf-88d238613b0e', '8deead73-f5c7-4c2c-8b92-239e81fb42da', '7756d549-32f3-48c6-be46-e4c4d19043d2'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:11 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:16:11 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-755a4a38-1809-4047-a6f6-9ed381581487 tempest-ProjectMemberTests-870165117 None] Lock "cinder-ba6d74e6-6786-4fdb-bc7c-263414c0d50d-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-98d0d56f-0a60-470c-a1ec-8f205e578742-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Lock "cinder-98d0d56f-0a60-470c-a1ec-8f205e578742-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-98d0d56f-0a60-470c-a1ec-8f205e578742" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-98d0d56f-0a60-470c-a1ec-8f205e578742" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264e296-2db5-4b1a-b676-9fe57c1318c0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:12 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742
Nov 05 12:16:12 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:12 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742" returned: 0 in 0.405s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:12 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:12 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742
Nov 05 12:16:12 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:13 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-98d0d56f-0a60-470c-a1ec-8f205e578742" returned: 0 in 0.265s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-98d0d56f-0a60-470c-a1ec-8f205e578742" released by "delete_volume" :: held 0.747s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Created reservations ['213e24d4-3395-496d-9a5f-9f5d272ea9ea', 'accccae4-58cd-4bb3-8a02-c89ef0b8cfe4', '9417bd52-b810-4a13-9025-e5194bbeb2ef', '6be715b4-7fce-459f-b33a-f618c43a1426'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:13 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:13 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:13 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.265s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:13 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-c4e9a6d0-6d3f-4cc1-9d50-b0cf621d5807 tempest-ProjectMemberTests-870165117 None] Lock "cinder-98d0d56f-0a60-470c-a1ec-8f205e578742-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:13 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:13 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:13 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.280s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:16:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (fb4f5e82-cb62-4dcb-97fd-fed3fb358761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153452ea-7bac-4981-bbc7-1bec1b7b8cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153452ea-7bac-4981-bbc7-1bec1b7b8cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661356705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edb075e-fdbd-4a78-a237-8c756f878acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:14Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9280124b-4f46-4167-88ad-1b5eaae2c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9280124b-4f46-4167-88ad-1b5eaae2c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da78548e-1dba-468f-9e47-732b46474099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da78548e-1dba-468f-9e47-732b46474099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edb075e-fdbd-4a78-a237-8c756f878acc', 'volume_name': 'volume-2edb075e-fdbd-4a78-a237-8c756f878acc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8183369-e170-4840-b56c-4ea2e5817b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8183369-e170-4840-b56c-4ea2e5817b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b409b472-3f60-4a9a-9149-44cb28398e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:14 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Volume 2edb075e-fdbd-4a78-a237-8c756f878acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edb075e-fdbd-4a78-a237-8c756f878acc', 'volume_size': 1}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661356705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edb075e-fdbd-4a78-a237-8c756f878acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:14Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Creating volume 2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:16:14 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:14 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc 1073741824
Nov 05 12:16:14 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:14 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc 1073741824" returned: 0 in 0.509s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:14 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:14 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc
Nov 05 12:16:14 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:15 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc" returned: 0 in 0.295s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:15 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:16:15 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b409b472-3f60-4a9a-9149-44cb28398e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edb075e-fdbd-4a78-a237-8c756f878acc', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab07df-71f9-4b58-9f26-6524a5a7c10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:15 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Volume volume-2edb075e-fdbd-4a78-a237-8c756f878acc (2edb075e-fdbd-4a78-a237-8c756f878acc): created successfully
Nov 05 12:16:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab07df-71f9-4b58-9f26-6524a5a7c10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:15 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (fb4f5e82-cb62-4dcb-97fd-fed3fb358761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:15 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9799790f-9b7e-4ae7-95b3-3f65bb37fc51 tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:16:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:16 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Creating offline snapshot 83ca6a3c-3b70-435f-bf6d-033b87f42939 of volume 2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:16:16 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[292fcec7-c03c-4601-92db-dbe72e69b81e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:16 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc
Nov 05 12:16:16 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:16 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:16 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:16 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 1G
Nov 05 12:16:16 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:17 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 1G" returned: 0 in 0.425s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edb075e-fdbd-4a78-a237-8c756f878acc -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:17 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edb075e-fdbd-4a78-a237-8c756f878acc -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939
Nov 05 12:16:17 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:17 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edb075e-fdbd-4a78-a237-8c756f878acc -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939" returned: 0 in 0.335s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:17 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 is being set with open permissions: ugo+rw
Nov 05 12:16:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:17 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939
Nov 05 12:16:17 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:17 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939" returned: 0 in 0.255s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:17 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.info
Nov 05 12:16:17 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:18 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.info" returned: 0 in 0.274s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:18 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.info is being set with open permissions: ugo+rw
Nov 05 12:16:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:18 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.info
Nov 05 12:16:18 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:18 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.info" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-827f33f1-6bba-4ab2-9732-891ac247e1a0 tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-83ca6a3c-3b70-435f-bf6d-033b87f42939-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Lock "cinder-83ca6a3c-3b70-435f-bf6d-033b87f42939-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-2edb075e-fdbd-4a78-a237-8c756f878acc" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-2edb075e-fdbd-4a78-a237-8c756f878acc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-83ca6a3c-3b70-435f-bf6d-033b87f42939" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-83ca6a3c-3b70-435f-bf6d-033b87f42939" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot 83ca6a3c-3b70-435f-bf6d-033b87f42939 of volume 2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[47745fa8-d8b1-484a-adae-cbbc02ecf3a7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:19 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939
Nov 05 12:16:19 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:19 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939" returned: 0 in 0.388s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2edb075e-fdbd-4a78-a237-8c756f878acc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:20 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d31f1-85bf-4609-a5ce-e35303c79fa2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:20 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc
Nov 05 12:16:20 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:20 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc" returned: 0 in 0.398s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:20 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939
Nov 05 12:16:20 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:20 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939" returned: 0 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:20 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939
Nov 05 12:16:20 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:21 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc.83ca6a3c-3b70-435f-bf6d-033b87f42939" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-83ca6a3c-3b70-435f-bf6d-033b87f42939" released by "_delete_snapshot" :: held 1.608s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-2edb075e-fdbd-4a78-a237-8c756f878acc" released by "delete_snapshot" :: held 1.634s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Created reservations ['2ff704a5-1d8e-4e56-ba10-c6a3464076e5', '796bdf45-afd2-4a25-83e3-ac5770dca305', '305f0354-0b3b-4abf-9a9f-a2265a896683', '5d777027-09ba-4f14-a3e5-e31e4d7ffb2d'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:21 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0f46f0e6-220e-4c1a-8a98-298c3b5dc07e tempest-ProjectMemberTests-870165117 None] Lock "cinder-83ca6a3c-3b70-435f-bf6d-033b87f42939-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-2edb075e-fdbd-4a78-a237-8c756f878acc-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Lock "cinder-2edb075e-fdbd-4a78-a237-8c756f878acc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-2edb075e-fdbd-4a78-a237-8c756f878acc" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-2edb075e-fdbd-4a78-a237-8c756f878acc" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409bca5-0996-47c2-832d-5c331809b523]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:21 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc
Nov 05 12:16:21 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:22 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc" returned: 0 in 0.389s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:22 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc
Nov 05 12:16:22 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:22 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-2edb075e-fdbd-4a78-a237-8c756f878acc" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-2edb075e-fdbd-4a78-a237-8c756f878acc" released by "delete_volume" :: held 0.754s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Created reservations ['c62986c8-4cb4-4a34-ac3b-9223ef59f918', '1b6e3f54-6004-4e3b-b873-651d820a634e', '6ba2d9f9-8d2f-4f14-b211-a95361897038', '78515c7f-18b1-4c68-afdd-8898d17b3104'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:22 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:22 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:22 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.310s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:22 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:16:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-b1c428c8-8f78-41a9-90d0-fa32b6c3362a tempest-ProjectMemberTests-870165117 None] Lock "cinder-2edb075e-fdbd-4a78-a237-8c756f878acc-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (8d9a1bc8-b47a-458b-ac52-0e24a8f57e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e1ffd7-5756-479a-a942-3fb03d59b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e1ffd7-5756-479a-a942-3fb03d59b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744226447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81e47e2-088b-431b-9129-0a3fad6c844e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:23Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6446fd7f-ac22-4e83-b1b7-0066286e247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6446fd7f-ac22-4e83-b1b7-0066286e247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29caffa-0529-4655-8dfb-9086c0ee9c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29caffa-0529-4655-8dfb-9086c0ee9c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81e47e2-088b-431b-9129-0a3fad6c844e', 'volume_name': 'volume-d81e47e2-088b-431b-9129-0a3fad6c844e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4c88cc-09e1-4f22-8c43-978b8432f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4c88cc-09e1-4f22-8c43-978b8432f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4102e13-e4a2-4d3a-8a25-640ce93a1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:23 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Volume d81e47e2-088b-431b-9129-0a3fad6c844e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81e47e2-088b-431b-9129-0a3fad6c844e', 'volume_size': 1}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744226447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81e47e2-088b-431b-9129-0a3fad6c844e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:23Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Creating volume d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:16:23 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:16:23 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:23 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e 1073741824
Nov 05 12:16:23 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:24 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e 1073741824" returned: 0 in 0.501s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:24 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e
Nov 05 12:16:24 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:24 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4102e13-e4a2-4d3a-8a25-640ce93a1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81e47e2-088b-431b-9129-0a3fad6c844e', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08830ef7-d17b-4485-b320-829f50feabe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:24 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Volume volume-d81e47e2-088b-431b-9129-0a3fad6c844e (d81e47e2-088b-431b-9129-0a3fad6c844e): created successfully
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08830ef7-d17b-4485-b320-829f50feabe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:24 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (8d9a1bc8-b47a-458b-ac52-0e24a8f57e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:24 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-3beb26e8-594d-4ef7-917f-b9c1ee554642 tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:16:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:25 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Creating offline snapshot b358d2f7-185a-4eb3-b2f9-0165d9187d6e of volume d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:16:25 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf764f9-2176-4d98-bff1-4eef03e22ea7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:25 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:25 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e
Nov 05 12:16:25 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:26 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e" returned: 0 in 0.427s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:26 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e 1G
Nov 05 12:16:26 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:26 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e 1G" returned: 0 in 0.446s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81e47e2-088b-431b-9129-0a3fad6c844e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:26 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81e47e2-088b-431b-9129-0a3fad6c844e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e
Nov 05 12:16:26 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:26 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81e47e2-088b-431b-9129-0a3fad6c844e -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e" returned: 0 in 0.308s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:26 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e is being set with open permissions: ugo+rw
Nov 05 12:16:26 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:26 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e
Nov 05 12:16:26 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:27 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:27 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.info
Nov 05 12:16:27 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:27 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.info" returned: 0 in 0.273s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:27 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.info is being set with open permissions: ugo+rw
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:27 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.info
Nov 05 12:16:27 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:27 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.info" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=157,cinder:INSERT=76,cinder:UPDATE=215,cinder:DELETE=16 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:16:27 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=175,cinder:INSERT=46,cinder:UPDATE=221,cinder:DELETE=21 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:16:27 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-476ada2b-da92-4dac-a4cd-7a9c81ba1e23 tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:16:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-b358d2f7-185a-4eb3-b2f9-0165d9187d6e-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Lock "cinder-b358d2f7-185a-4eb3-b2f9-0165d9187d6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-d81e47e2-088b-431b-9129-0a3fad6c844e" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-d81e47e2-088b-431b-9129-0a3fad6c844e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-b358d2f7-185a-4eb3-b2f9-0165d9187d6e" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:28 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-b358d2f7-185a-4eb3-b2f9-0165d9187d6e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:28 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot b358d2f7-185a-4eb3-b2f9-0165d9187d6e of volume d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[7666d8fb-9e58-478c-b89a-95af3033e108]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:29 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e
Nov 05 12:16:29 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:29 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e" returned: 0 in 0.363s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d81e47e2-088b-431b-9129-0a3fad6c844e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1920698-4019-4833-8c43-931ae21fc958]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:29 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e
Nov 05 12:16:29 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:29 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e" returned: 0 in 0.456s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:29 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:29 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e
Nov 05 12:16:29 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:30 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e" returned: 0 in 0.397s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:30 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e
Nov 05 12:16:30 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:30 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:30 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e.b358d2f7-185a-4eb3-b2f9-0165d9187d6e" returned: 0 in 0.316s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-b358d2f7-185a-4eb3-b2f9-0165d9187d6e" released by "_delete_snapshot" :: held 1.678s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-d81e47e2-088b-431b-9129-0a3fad6c844e" released by "delete_snapshot" :: held 1.703s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:30 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Created reservations ['a0efac77-840d-42a6-b4f5-a15321cf8486', 'bd1dbd9f-7bd0-4979-b181-6853177f85a0', 'c7bbe9da-ce39-4a4f-b19b-09d25a4a4c1c', '5ede5f06-0bcf-4d99-ae5e-022394d5c56d'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:30 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:16:30 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0cd00bf1-55d5-4f30-b125-1967892fbb50 tempest-ProjectMemberTests-870165117 None] Lock "cinder-b358d2f7-185a-4eb3-b2f9-0165d9187d6e-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-d81e47e2-088b-431b-9129-0a3fad6c844e-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Lock "cinder-d81e47e2-088b-431b-9129-0a3fad6c844e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-d81e47e2-088b-431b-9129-0a3fad6c844e" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-d81e47e2-088b-431b-9129-0a3fad6c844e" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7779f-2163-4b64-b0c1-6150b121aa8c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:31 devstack sudo[107093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e
Nov 05 12:16:31 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:31 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e" returned: 0 in 0.434s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:31 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:31 devstack sudo[107098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e
Nov 05 12:16:31 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:32 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-d81e47e2-088b-431b-9129-0a3fad6c844e" returned: 0 in 0.287s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-d81e47e2-088b-431b-9129-0a3fad6c844e" released by "delete_volume" :: held 0.837s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Created reservations ['7662a0a8-f621-4d92-a9e0-b52c7dbe8485', '2004cfb8-0b3a-44d7-9147-66727210255e', 'aeb55849-4426-4b21-912a-2d033fc8ca88', 'c31b36aa-7398-4039-b8fd-bd9ae28b881c'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:32 devstack sudo[107101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:32 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:32 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.268s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:32 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-6887c42f-a4b2-433a-a4d1-6eddf14135ce tempest-ProjectMemberTests-870165117 None] Lock "cinder-d81e47e2-088b-431b-9129-0a3fad6c844e-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (cbb4d610-6331-46f9-bf75-c1958435d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4a75e7-47fb-4029-8dba-bd06a42c883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4a75e7-47fb-4029-8dba-bd06a42c883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654379339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1562175-4060-400a-bb27-ad4d61a6adce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:33Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4f3a40-6deb-474d-acf2-d960ad309d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4f3a40-6deb-474d-acf2-d960ad309d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6121f75a-971b-4f3b-ab5b-db5ee4093d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6121f75a-971b-4f3b-ab5b-db5ee4093d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1562175-4060-400a-bb27-ad4d61a6adce', 'volume_name': 'volume-c1562175-4060-400a-bb27-ad4d61a6adce', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4453d5ff-afbe-4dd3-8438-44b973cd3b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4453d5ff-afbe-4dd3-8438-44b973cd3b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5606a42-438a-4d5b-a9cd-6ca88b3bd7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:32 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Volume c1562175-4060-400a-bb27-ad4d61a6adce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1562175-4060-400a-bb27-ad4d61a6adce', 'volume_size': 1}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654379339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1562175-4060-400a-bb27-ad4d61a6adce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:33Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Creating volume c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:16:32 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:16:32 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:32 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce 1073741824
Nov 05 12:16:32 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:33 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce 1073741824" returned: 0 in 0.458s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:33 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce
Nov 05 12:16:33 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:33 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce" returned: 0 in 0.249s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5606a42-438a-4d5b-a9cd-6ca88b3bd7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1562175-4060-400a-bb27-ad4d61a6adce', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675e0167-cf64-46bb-bff3-e62f1927facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:33 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Volume volume-c1562175-4060-400a-bb27-ad4d61a6adce (c1562175-4060-400a-bb27-ad4d61a6adce): created successfully
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675e0167-cf64-46bb-bff3-e62f1927facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:33 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (cbb4d610-6331-46f9-bf75-c1958435d944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:33 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-12ce5886-32d6-44ef-a38d-ae4dacc4c7cc tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Creating offline snapshot 89df7704-7aa2-4209-a6af-19d4a769ee7e of volume c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100f1c8-cc59-4021-ad1a-6fa4f0980cca]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:35 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce
Nov 05 12:16:35 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Flow 'volume_create_manager' (ae9ceb46-27b9-44ce-9b76-2d22e3cd21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8085a2bb-61cc-44bd-9ef4-e418195141f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8085a2bb-61cc-44bd-9ef4-e418195141f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1200158525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c383a628-dbd7-460f-baca-27631880ef5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2fed03e95f841b3b04d8c32c38f39ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:35Z,use_quota=True,user_id='0a346d8143144a7194f24a195851b3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa00fb8-fd25-45c2-879c-e783a0e8735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa00fb8-fd25-45c2-879c-e783a0e8735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a036c2aa-caf1-4e52-a78d-c22f73ce7736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a036c2aa-caf1-4e52-a78d-c22f73ce7736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c383a628-dbd7-460f-baca-27631880ef5c', 'volume_name': 'volume-c383a628-dbd7-460f-baca-27631880ef5c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d17b69-fda1-49bd-94aa-8a64ca145c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d17b69-fda1-49bd-94aa-8a64ca145c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58b281c-f99c-4b70-969b-a1e333701eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:35 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Volume c383a628-dbd7-460f-baca-27631880ef5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c383a628-dbd7-460f-baca-27631880ef5c', 'volume_size': 1}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:35 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce" returned: 0 in 0.408s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:35 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e 1G
Nov 05 12:16:35 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:35 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e 1G" returned: 0 in 0.391s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:35 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1562175-4060-400a-bb27-ad4d61a6adce -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:35 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1562175-4060-400a-bb27-ad4d61a6adce -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e
Nov 05 12:16:35 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:36 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1562175-4060-400a-bb27-ad4d61a6adce -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e" returned: 0 in 0.298s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:36 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e is being set with open permissions: ugo+rw
Nov 05 12:16:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:36 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e
Nov 05 12:16:36 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:36 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e" returned: 0 in 0.242s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:36 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.info
Nov 05 12:16:36 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:36 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.info" returned: 0 in 0.252s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:36 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.info is being set with open permissions: ugo+rw
Nov 05 12:16:36 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:36 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.info
Nov 05 12:16:36 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:37 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.info" returned: 0 in 0.240s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1200158525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c383a628-dbd7-460f-baca-27631880ef5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2fed03e95f841b3b04d8c32c38f39ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:35Z,use_quota=True,user_id='0a346d8143144a7194f24a195851b3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Creating volume c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:16:37 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:37 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c 1073741824
Nov 05 12:16:37 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-c63a380c-f1d0-4d10-ba93-bba926eb6a6b tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:16:37 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c 1073741824" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:37 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c
Nov 05 12:16:37 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:37 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c" returned: 0 in 0.241s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58b281c-f99c-4b70-969b-a1e333701eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c383a628-dbd7-460f-baca-27631880ef5c', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41aae2a9-de32-4901-9258-b0198b5dc56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:37 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Volume volume-c383a628-dbd7-460f-baca-27631880ef5c (c383a628-dbd7-460f-baca-27631880ef5c): created successfully
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41aae2a9-de32-4901-9258-b0198b5dc56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:37 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Flow 'volume_create_manager' (ae9ceb46-27b9-44ce-9b76-2d22e3cd21ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:37 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-aab342f6-4860-4968-9517-307c86124274 tempest-SnapshotDependencyTests-1116098337 None] Created volume successfully.
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-89df7704-7aa2-4209-a6af-19d4a769ee7e-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Lock "cinder-89df7704-7aa2-4209-a6af-19d4a769ee7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-c1562175-4060-400a-bb27-ad4d61a6adce" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-c1562175-4060-400a-bb27-ad4d61a6adce" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-89df7704-7aa2-4209-a6af-19d4a769ee7e" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-89df7704-7aa2-4209-a6af-19d4a769ee7e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot 89df7704-7aa2-4209-a6af-19d4a769ee7e of volume c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fe8de6-3e67-4775-a669-485952f2f9c2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:38 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e
Nov 05 12:16:38 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Creating offline snapshot 0ee5f206-c97a-4253-9c1e-125ced995acd of volume c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdc9acb-89d5-4fd2-83ff-571ea5cf067a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:38 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e" returned: 0 in 0.377s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1562175-4060-400a-bb27-ad4d61a6adce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3fe392-ed00-48f8-862d-1d158036af8f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:38 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:38 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c
Nov 05 12:16:38 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:38 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce
Nov 05 12:16:38 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:39 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c" returned: 0 in 0.413s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:39 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd 1G
Nov 05 12:16:39 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:39 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce" returned: 0 in 0.368s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:39 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e
Nov 05 12:16:39 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:39 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e" returned: 0 in 0.373s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:39 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd 1G" returned: 0 in 0.436s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c383a628-dbd7-460f-baca-27631880ef5c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:39 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e
Nov 05 12:16:39 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:39 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c383a628-dbd7-460f-baca-27631880ef5c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd
Nov 05 12:16:39 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:39 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce.89df7704-7aa2-4209-a6af-19d4a769ee7e" returned: 0 in 0.253s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-89df7704-7aa2-4209-a6af-19d4a769ee7e" released by "_delete_snapshot" :: held 1.483s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-c1562175-4060-400a-bb27-ad4d61a6adce" released by "delete_snapshot" :: held 1.509s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:39 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c383a628-dbd7-460f-baca-27631880ef5c -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd" returned: 0 in 0.301s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:39 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd is being set with open permissions: ugo+rw
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:39 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd
Nov 05 12:16:39 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Created reservations ['6cf51b5e-cddf-4b5b-ad67-ece2de4fd95e', 'b5626a9a-bf0e-4e4e-9942-be8e2c963ad0', '477413a3-81e6-4ec1-b789-c16c4a967599', 'c8f68c03-f869-4368-ad90-114ba5cfc0d7'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:39 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:16:39 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-bd059b55-1edb-4e25-b191-22775a2d83bd tempest-ProjectMemberTests-870165117 None] Lock "cinder-89df7704-7aa2-4209-a6af-19d4a769ee7e-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:40 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd" returned: 0 in 0.255s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:40 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.info
Nov 05 12:16:40 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:40 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.info" returned: 0 in 0.265s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:40 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.info is being set with open permissions: ugo+rw
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:40 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.info
Nov 05 12:16:40 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-c1562175-4060-400a-bb27-ad4d61a6adce-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Lock "cinder-c1562175-4060-400a-bb27-ad4d61a6adce-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-c1562175-4060-400a-bb27-ad4d61a6adce" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-c1562175-4060-400a-bb27-ad4d61a6adce" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a12cba-0410-43ef-aef5-7b614da5eb5e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:40 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.info" returned: 0 in 0.264s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:40 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce
Nov 05 12:16:40 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:40 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-e58ba5f8-c0a8-4a38-b294-e1672f848c7f tempest-SnapshotDependencyTests-1116098337 None] Create snapshot completed successfully
Nov 05 12:16:40 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce" returned: 0 in 0.379s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:40 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:40 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce
Nov 05 12:16:40 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:41 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c1562175-4060-400a-bb27-ad4d61a6adce" returned: 0 in 0.250s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-c1562175-4060-400a-bb27-ad4d61a6adce" released by "delete_volume" :: held 0.692s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Created reservations ['b4fa04a6-4c27-4636-8504-e7bc8af83853', 'bdfbc05d-150a-428f-a994-5f26893d7947', '55bb62a4-5a53-45af-8848-7e3ae6f31fe1', 'f0587145-210f-4ada-893a-bd58ec9b65ab'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:41 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:41 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:41 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.255s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:41 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:16:41 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8f64cec4-e7ac-4341-92c9-c7c2d590d29f tempest-ProjectMemberTests-870165117 None] Lock "cinder-c1562175-4060-400a-bb27-ad4d61a6adce-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (43d874df-23e7-41c2-a9a3-978db4a3f40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4b9bc0-08f6-42ff-bada-7a2b40a69141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4b9bc0-08f6-42ff-bada-7a2b40a69141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739517658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc89288b-a424-4054-bd45-d859727b37ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:42Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b300fd-1b5e-469e-9267-e988365d292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b300fd-1b5e-469e-9267-e988365d292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccb3826-242f-463e-8c23-e73a3406afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccb3826-242f-463e-8c23-e73a3406afd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc89288b-a424-4054-bd45-d859727b37ce', 'volume_name': 'volume-cc89288b-a424-4054-bd45-d859727b37ce', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811c9ce4-78f7-4e91-b522-0631ade6e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811c9ce4-78f7-4e91-b522-0631ade6e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965b9883-12fd-453f-8d2f-1ff50b1c0192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Volume cc89288b-a424-4054-bd45-d859727b37ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc89288b-a424-4054-bd45-d859727b37ce', 'volume_size': 1}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739517658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc89288b-a424-4054-bd45-d859727b37ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63d9ce581694e22a45d5b16a4ba144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:42Z,use_quota=True,user_id='e4a9efa6a9ad4e189c9957ae4b259087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Creating volume cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:16:42 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:42 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce 1073741824
Nov 05 12:16:42 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Flow 'volume_create_manager' (ee3f0a74-3dd1-4fef-b555-fa9a489bbdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608dc5db-5019-490f-bcac-d17ae10d8180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608dc5db-5019-490f-bcac-d17ae10d8180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3596f4-a799-474b-bcd9-a9a6722c2282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2fed03e95f841b3b04d8c32c38f39ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0ee5f206-c97a-4253-9c1e-125ced995acd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:16:42Z,use_quota=True,user_id='0a346d8143144a7194f24a195851b3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fdd6ff-e58c-4a67-a0da-3ea52248bd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fdd6ff-e58c-4a67-a0da-3ea52248bd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b067889-8397-4b07-bc08-77bafb09a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b067889-8397-4b07-bc08-77bafb09a67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b3596f4-a799-474b-bcd9-a9a6722c2282', 'volume_name': 'volume-7b3596f4-a799-474b-bcd9-a9a6722c2282', 'volume_size': 1, 'snapshot_id': '0ee5f206-c97a-4253-9c1e-125ced995acd'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92268254-f224-4709-a5d3-056a28dce0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92268254-f224-4709-a5d3-056a28dce0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6bdaa76-255c-40fd-8bd2-0f5e1c27167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Volume 7b3596f4-a799-474b-bcd9-a9a6722c2282: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b3596f4-a799-474b-bcd9-a9a6722c2282', 'volume_size': 1, 'snapshot_id': '0ee5f206-c97a-4253-9c1e-125ced995acd'}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:42 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce 1073741824" returned: 0 in 0.440s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:42 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce
Nov 05 12:16:42 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:42 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce" returned: 0 in 0.244s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.419s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-quobyte-0ee5f206-c97a-4253-9c1e-125ced995acd-7b3596f4-a799-474b-bcd9-a9a6722c2282" by "_create_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965b9883-12fd-453f-8d2f-1ff50b1c0192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc89288b-a424-4054-bd45-d859727b37ce', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5636a96-6873-4fd8-8b92-865f78eb47a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-0ee5f206-c97a-4253-9c1e-125ced995acd-7b3596f4-a799-474b-bcd9-a9a6722c2282" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Creating volume 7b3596f4-a799-474b-bcd9-a9a6722c2282 from snapshot 0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-quobyte-7b3596f4-a799-474b-bcd9-a9a6722c2282" by "_copy_volume_from_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:42 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Volume volume-cc89288b-a424-4054-bd45-d859727b37ce (cc89288b-a424-4054-bd45-d859727b37ce): created successfully
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5636a96-6873-4fd8-8b92-865f78eb47a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Flow 'volume_create_manager' (43d874df-23e7-41c2-a9a3-978db4a3f40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-7b3596f4-a799-474b-bcd9-a9a6722c2282" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:42 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] snapshot: 0ee5f206-c97a-4253-9c1e-125ced995acd, volume: 7b3596f4-a799-474b-bcd9-a9a6722c2282,  {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 12:16:42 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-511adf83-03eb-4de6-8192-e07028bd0a6d tempest-ProjectMemberTests-870165117 None] Created volume successfully.
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[75161076-5ef9-4fff-ab8d-0042ae899cbd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:43 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd
Nov 05 12:16:43 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:43 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd" returned: 0 in 0.383s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c383a628-dbd7-460f-baca-27631880ef5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c00a028-378a-40e7-9804-1ebf9b4d1834]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:43 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c
Nov 05 12:16:43 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:43 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c" returned: 0 in 0.349s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Creating direct copy from snapshot {{(pid=87317) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG cinder.utils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Path /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 not found in is_blk_device check {{(pid=87317) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 12:16:43 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:43 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282
Nov 05 12:16:43 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:49 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282" returned: 0 in 6.013s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:49 devstack cinder-volume[87317]: DEBUG cinder.image.image_utils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Image conversion details: src /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 {{(pid=87317) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 12:16:49 devstack cinder-volume[87317]: INFO cinder.image.image_utils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Converted 1024.00 MB image at 170.26 MB/s
Nov 05 12:16:49 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 is being set with open permissions: ugo+rw
Nov 05 12:16:49 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:49 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282
Nov 05 12:16:49 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:50 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282" returned: 0 in 0.230s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-7b3596f4-a799-474b-bcd9-a9a6722c2282" released by "_copy_volume_from_snapshot" :: held 7.088s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-0ee5f206-c97a-4253-9c1e-125ced995acd-7b3596f4-a799-474b-bcd9-a9a6722c2282" released by "_create_volume_from_snapshot" :: held 7.164s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.197s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.832s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Creating offline snapshot 09be1997-740b-4ad1-9c82-176db7893630 of volume cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6bdaa76-255c-40fd-8bd2-0f5e1c27167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3596f4-a799-474b-bcd9-a9a6722c2282', 'volume_size': 1, 'snapshot_id': '0ee5f206-c97a-4253-9c1e-125ced995acd'}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68e661f-803b-47dc-928d-e4d1d934f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47c2d01-17d6-4f0c-8cec-97254f92b33a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:50 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Volume volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 (7b3596f4-a799-474b-bcd9-a9a6722c2282): created successfully
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68e661f-803b-47dc-928d-e4d1d934f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Flow 'volume_create_manager' (ee3f0a74-3dd1-4fef-b555-fa9a489bbdf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:16:50 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-de163acd-c89c-450d-a308-4b34266adb50 tempest-SnapshotDependencyTests-1116098337 None] Created volume successfully.
Nov 05 12:16:50 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce
Nov 05 12:16:50 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:50 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce" returned: 0 in 0.351s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 1G {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:50 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 1G
Nov 05 12:16:50 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:50 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 1G" returned: 0 in 0.395s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:50 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc89288b-a424-4054-bd45-d859727b37ce -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:50 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc89288b-a424-4054-bd45-d859727b37ce -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630
Nov 05 12:16:50 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-0ee5f206-c97a-4253-9c1e-125ced995acd-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-0ee5f206-c97a-4253-9c1e-125ced995acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-quobyte-c383a628-dbd7-460f-baca-27631880ef5c" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-c383a628-dbd7-460f-baca-27631880ef5c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-quobyte-0ee5f206-c97a-4253-9c1e-125ced995acd" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-0ee5f206-c97a-4253-9c1e-125ced995acd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Deleting offline snapshot 0ee5f206-c97a-4253-9c1e-125ced995acd of volume c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] snapshot_file for this snap is: volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:16:51 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c872ab-f5b2-40bb-b526-7285de2c36e6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc89288b-a424-4054-bd45-d859727b37ce -F qcow2 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630" returned: 0 in 0.309s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:51 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 is being set with open permissions: ugo+rw
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:51 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630
Nov 05 12:16:51 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:51 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd
Nov 05 12:16:51 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:51 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630" returned: 0 in 0.236s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:51 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.info
Nov 05 12:16:51 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:51 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd" returned: 0 in 0.352s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c383a628-dbd7-460f-baca-27631880ef5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[84191a3f-22dd-4a2f-b4af-92417762c11b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:51 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c
Nov 05 12:16:51 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:51 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.info" returned: 0 in 0.283s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:51 devstack cinder-volume[87317]: WARNING cinder.volume.drivers.remotefs [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.info is being set with open permissions: ugo+rw
Nov 05 12:16:51 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.info {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:51 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.info
Nov 05 12:16:51 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:52 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.info" returned: 0 in 0.249s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-010cf493-e0f8-41b6-9032-dfb897cd808f tempest-ProjectMemberTests-870165117 None] Create snapshot completed successfully
Nov 05 12:16:52 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c" returned: 0 in 0.558s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:52 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd
Nov 05 12:16:52 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:52 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd" returned: 0 in 0.341s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:52 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd
Nov 05 12:16:52 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:52 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c.0ee5f206-c97a-4253-9c1e-125ced995acd" returned: 0 in 0.275s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-0ee5f206-c97a-4253-9c1e-125ced995acd" released by "_delete_snapshot" :: held 1.647s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-c383a628-dbd7-460f-baca-27631880ef5c" released by "delete_snapshot" :: held 1.674s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Created reservations ['a733945e-2435-4f2b-8c96-293a1eaa08bf', 'f5666b93-0689-4565-b4b2-a87fee98d1d1', '0bc8589d-4675-498e-8dfa-451e16fca3ab', '68a2b46b-0216-423c-8967-592d629c078f'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:52 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Delete snapshot completed successfully.
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-09be1997-740b-4ad1-9c82-176db7893630-delete_snapshot" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-8bc7cd44-5c62-4da3-a6ac-f64d3250c5e0 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-0ee5f206-c97a-4253-9c1e-125ced995acd-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Lock "cinder-09be1997-740b-4ad1-9c82-176db7893630-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-cc89288b-a424-4054-bd45-d859727b37ce" by "delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-cc89288b-a424-4054-bd45-d859727b37ce" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-09be1997-740b-4ad1-9c82-176db7893630" by "_delete_snapshot" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-09be1997-740b-4ad1-9c82-176db7893630" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:52 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Deleting offline snapshot 09be1997-740b-4ad1-9c82-176db7893630 of volume cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] snapshot_file for this snap is: volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 {{(pid=87317) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7baa144-e741-490b-be6b-4584a6d24721]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:53 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630
Nov 05 12:16:53 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-c383a628-dbd7-460f-baca-27631880ef5c-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-c383a628-dbd7-460f-baca-27631880ef5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-quobyte-c383a628-dbd7-460f-baca-27631880ef5c" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-c383a628-dbd7-460f-baca-27631880ef5c" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d71351-46de-4557-8e23-18254652df45]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:53 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630" returned: 0 in 0.382s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc89288b-a424-4054-bd45-d859727b37ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87317) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5efbe7-7b24-4537-909b-eecbbd1227f5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:53 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c
Nov 05 12:16:53 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:53 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce
Nov 05 12:16:53 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:53 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c" returned: 0 in 0.379s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:53 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c
Nov 05 12:16:53 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:53 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce" returned: 0 in 0.375s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:53 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:53 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630
Nov 05 12:16:53 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:54 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-c383a628-dbd7-460f-baca-27631880ef5c" returned: 0 in 0.243s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-c383a628-dbd7-460f-baca-27631880ef5c" released by "delete_volume" :: held 0.698s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Created reservations ['23ddddb6-6095-41cf-a8e7-0c97d53cf177', 'd1374c60-8918-41db-a84c-83acb8972eca', '2df1f079-52d1-4e2d-945e-b75e456f560a', 'ed9ee69c-5ea8-4a7b-993c-e75aa0cda077'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:54 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630" returned: 0 in 0.361s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:54 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:54 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:54 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630
Nov 05 12:16:54 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:54 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-7b3596f4-a799-474b-bcd9-a9a6722c2282-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.267s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Deleted volume successfully.
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-7b3596f4-a799-474b-bcd9-a9a6722c2282-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:54 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce.09be1997-740b-4ad1-9c82-176db7893630" returned: 0 in 0.300s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7fc7d144-90e0-41d9-9961-f411a6bb5a1f tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-c383a628-dbd7-460f-baca-27631880ef5c-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-09be1997-740b-4ad1-9c82-176db7893630" released by "_delete_snapshot" :: held 1.528s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "cinder-quobyte-7b3596f4-a799-474b-bcd9-a9a6722c2282" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-cc89288b-a424-4054-bd45-d859727b37ce" released by "delete_snapshot" :: held 1.552s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-7b3596f4-a799-474b-bcd9-a9a6722c2282" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[75186285-1f71-4171-807d-0537a92511d5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Created reservations ['29144f92-8c89-4a1b-b97e-338a5c40320a', 'b7291a58-335c-4183-8dae-943b3bcbe856', '08761f59-2826-4ff4-87e3-dad3385f9022', '19f3dfb2-19d7-4488-940f-73a9804e7f87'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:54 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Delete snapshot completed successfully.
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-7b388c01-5e6b-4dcf-bfd7-97cce2627c90 tempest-ProjectMemberTests-870165117 None] Lock "cinder-09be1997-740b-4ad1-9c82-176db7893630-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:54 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282
Nov 05 12:16:54 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:54 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282" returned: 0 in 0.364s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:54 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:54 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282
Nov 05 12:16:54 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-cc89288b-a424-4054-bd45-d859727b37ce-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Lock "cinder-cc89288b-a424-4054-bd45-d859727b37ce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Acquiring lock "cinder-quobyte-cc89288b-a424-4054-bd45-d859727b37ce" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:16:55 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-cc89288b-a424-4054-bd45-d859727b37ce" acquired by "delete_volume" :: waited 0.018s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-7b3596f4-a799-474b-bcd9-a9a6722c2282" returned: 0 in 0.287s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-quobyte-7b3596f4-a799-474b-bcd9-a9a6722c2282" released by "delete_volume" :: held 0.698s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[57553823-0e14-4fd0-839a-6a39ba0bd418]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Created reservations ['b9545281-1d8a-4606-a711-d7f77c06e991', '2fc3e895-c125-49a0-9617-c1459870bfa4', '8dac03c0-bddb-4b7e-b258-5c5fecb2bc37', '6a8fe7ce-5232-41d3-9985-f5864913f660'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:55 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce
Nov 05 12:16:55 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:55 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:55 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:55 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce" returned: 0 in 0.394s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:55 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.281s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:55 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Deleted volume successfully.
Nov 05 12:16:55 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce
Nov 05 12:16:55 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f8a60d73-29a8-4f73-b83d-b9bb53c9f725 tempest-SnapshotDependencyTests-1116098337 None] Lock "cinder-7b3596f4-a799-474b-bcd9-a9a6722c2282-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:55 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-cc89288b-a424-4054-bd45-d859727b37ce" returned: 0 in 0.250s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Lock "cinder-quobyte-cc89288b-a424-4054-bd45-d859727b37ce" released by "delete_volume" :: held 0.717s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:16:55 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Created reservations ['4533eb98-b65e-4555-a4b8-17fa74c57ef9', 'b70f0eeb-45dd-4569-8ae5-5ebfbc53ce1a', 'b1ce475c-222c-4c0e-ad6b-fa5830f6d163', 'b95a1095-583e-4733-97b8-aa620d1d544d'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:16:56 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:16:56 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:16:56 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.280s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:16:56 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Deleted volume successfully.
Nov 05 12:16:56 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-0a5c8cb4-5590-4a4a-a2ae-b453591f114e tempest-ProjectMemberTests-870165117 None] Lock "cinder-cc89288b-a424-4054-bd45-d859727b37ce-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:17:06 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=52,cinder:INSERT=22,cinder:UPDATE=82,cinder:DELETE=7 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:17:06 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:DELETE=6,cinder:SELECT=72,cinder:INSERT=21,cinder:UPDATE=75 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:13 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:17:13 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:13 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.279s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG oslo_service.periodic_task [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] Running periodic task VolumeManager._thread_info {{(pid=87317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread count: 28 {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 12:17:13 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-25249f8c-527a-4df1-9beb-5661ca1b37bb None None] thread info: [<_MainThread(MainThread, started 137233605329024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137233493431232)>, <Thread(Thread-3 (stat_writer), started daemon 137233490388352)>, <Thread(Rabbit-heartbeat, started daemon 137233491247232)>, <Thread(Thread-5 (_runner), started daemon 137233489238400)>, <Thread(Thread-7 (_runner), started daemon 137233489346624)>, <Thread(fd_logger, started daemon 137233487021504)>, <Thread(privsep_reader, started daemon 137233487030592)>, <Thread(tpool_thread_0, started daemon 137233478301376)>, <Thread(tpool_thread_1, started daemon 137233469908672)>, <Thread(tpool_thread_2, started daemon 137233461515968)>, <Thread(tpool_thread_3, started daemon 137233453106880)>, <Thread(tpool_thread_4, started daemon 137233444697792)>, <Thread(tpool_thread_5, started daemon 137233436288704)>, <Thread(tpool_thread_6, started daemon 137233427879616)>, <Thread(tpool_thread_7, started daemon 137233419470528)>, <Thread(tpool_thread_8, started daemon 137233411061440)>, <Thread(tpool_thread_9, started daemon 137233402652352)>, <Thread(tpool_thread_10, started daemon 137233394243264)>, <Thread(tpool_thread_11, started daemon 137233385834176)>, <Thread(tpool_thread_12, started daemon 137233377425088)>, <Thread(tpool_thread_13, started daemon 137233369016000)>, <Thread(tpool_thread_14, started daemon 137233360606912)>, <Thread(tpool_thread_15, started daemon 137233352197824)>, <Thread(tpool_thread_16, started daemon 137233343788736)>, <Thread(tpool_thread_17, started daemon 137233335379648)>, <Thread(tpool_thread_18, started daemon 137233326970560)>, <Thread(tpool_thread_19, started daemon 137233318561472)>] {{(pid=87317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Flow 'volume_create_manager' (fcf17b9d-990c-4aae-a4cb-a24d0c1905b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e716b1-f958-4e89-abb3-5a9ba4f80b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e716b1-f958-4e89-abb3-5a9ba4f80b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046303908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f949032d-3d69-4346-bd29-4f20aea7879a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d61c4d6d1db4c849f15dd84879f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:17Z,use_quota=True,user_id='e74f64ed88104b3ba3442aee575b93a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e7cf99-873f-4e79-8e33-f72e049addf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e7cf99-873f-4e79-8e33-f72e049addf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afe5600-2af6-4916-86fa-187b0de69a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afe5600-2af6-4916-86fa-187b0de69a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f949032d-3d69-4346-bd29-4f20aea7879a', 'volume_name': 'volume-f949032d-3d69-4346-bd29-4f20aea7879a', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c753d5ab-2c00-4b93-aca6-d04fcaa5a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c753d5ab-2c00-4b93-aca6-d04fcaa5a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c733392-0414-4366-a148-84b4fe534d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:17 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Volume f949032d-3d69-4346-bd29-4f20aea7879a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f949032d-3d69-4346-bd29-4f20aea7879a', 'volume_size': 1}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046303908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f949032d-3d69-4346-bd29-4f20aea7879a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d61c4d6d1db4c849f15dd84879f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:17Z,use_quota=True,user_id='e74f64ed88104b3ba3442aee575b93a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Creating volume f949032d-3d69-4346-bd29-4f20aea7879a {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:17:17 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:17 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a 1073741824
Nov 05 12:17:17 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:17 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a 1073741824" returned: 0 in 0.419s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:17 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:17 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a
Nov 05 12:17:17 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:18 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a" returned: 0 in 0.244s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c733392-0414-4366-a148-84b4fe534d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f949032d-3d69-4346-bd29-4f20aea7879a', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854ec2e3-183d-4951-9121-804d9f814976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:18 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Volume volume-f949032d-3d69-4346-bd29-4f20aea7879a (f949032d-3d69-4346-bd29-4f20aea7879a): created successfully
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854ec2e3-183d-4951-9121-804d9f814976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Flow 'volume_create_manager' (fcf17b9d-990c-4aae-a4cb-a24d0c1905b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:17:18 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-5c2a7811-50eb-42b3-ac0a-41818c1bc9fc tempest-ProjectReaderTests-2041145467 None] Created volume successfully.
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Acquiring lock "cinder-f949032d-3d69-4346-bd29-4f20aea7879a-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-f949032d-3d69-4346-bd29-4f20aea7879a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Acquiring lock "cinder-quobyte-f949032d-3d69-4346-bd29-4f20aea7879a" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-quobyte-f949032d-3d69-4346-bd29-4f20aea7879a" acquired by "delete_volume" :: waited 0.015s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a09cf-87a6-40c8-83a3-38093440fe6e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:18 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a
Nov 05 12:17:18 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:18 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a" returned: 0 in 0.352s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:18 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:18 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a
Nov 05 12:17:18 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:19 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-f949032d-3d69-4346-bd29-4f20aea7879a" returned: 0 in 0.259s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-quobyte-f949032d-3d69-4346-bd29-4f20aea7879a" released by "delete_volume" :: held 0.651s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Created reservations ['020297d5-49d0-4d64-ab22-7a4be78f724f', '99644360-9e79-451d-85b4-d39c12d4773d', '7ef8dc32-fc06-4f50-b498-377474c94259', '3194ff99-f93d-4c4d-8d23-d6dd765e1412'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:19 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:17:19 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:19 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.246s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:17:19 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Deleted volume successfully.
Nov 05 12:17:19 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-f49132da-c5ee-499b-baa7-0245d0c8ac72 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-f949032d-3d69-4346-bd29-4f20aea7879a-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87317) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Flow 'volume_create_manager' (d19b5714-b983-4787-afa3-b3523fbe6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca74adef-6962-427a-b04d-3946d9fd081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca74adef-6962-427a-b04d-3946d9fd081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453497272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055db634-1922-457d-ab7e-7e5db857a316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d61c4d6d1db4c849f15dd84879f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:20Z,use_quota=True,user_id='e74f64ed88104b3ba3442aee575b93a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96c921d-9a03-487f-b139-99f6eb997878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96c921d-9a03-487f-b139-99f6eb997878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20d9fe6-c5d7-4755-a870-ae5c8c23664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20d9fe6-c5d7-4755-a870-ae5c8c23664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055db634-1922-457d-ab7e-7e5db857a316', 'volume_name': 'volume-055db634-1922-457d-ab7e-7e5db857a316', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d65e9e9-586d-4478-b245-e0ff8afba24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d65e9e9-586d-4478-b245-e0ff8afba24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029634d-346c-4441-9840-5aaec8260b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:20 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Volume 055db634-1922-457d-ab7e-7e5db857a316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055db634-1922-457d-ab7e-7e5db857a316', 'volume_size': 1}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cd02a1782f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453497272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055db634-1922-457d-ab7e-7e5db857a316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d61c4d6d1db4c849f15dd84879f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T11:17:20Z,use_quota=True,user_id='e74f64ed88104b3ba3442aee575b93a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b974ff-2776-43de-b65b-812c26458759),volume_type_id=d4b974ff-2776-43de-b65b-812c26458759)}" {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.remotefs [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Creating volume 055db634-1922-457d-ab7e-7e5db857a316 {{(pid=87317) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Selected osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff as target Quobyte volume. {{(pid=87317) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 12:17:20 devstack cinder-volume[87317]: INFO cinder.volume.drivers.remotefs [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] casted to osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316 1073741824 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:20 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316 1073741824
Nov 05 12:17:20 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:20 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316 1073741824" returned: 0 in 0.414s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:20 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316
Nov 05 12:17:20 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:20 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316" returned: 0 in 0.249s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'} {{(pid=87317) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029634d-346c-4441-9840-5aaec8260b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055db634-1922-457d-ab7e-7e5db857a316', 'volume_size': 1}' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af87de8-b501-4a4f-b324-faf30a8e128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 12:17:20 devstack cinder-volume[87317]: INFO cinder.volume.flows.manager.create_volume [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Volume volume-055db634-1922-457d-ab7e-7e5db857a316 (055db634-1922-457d-ab7e-7e5db857a316): created successfully
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af87de8-b501-4a4f-b324-faf30a8e128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87317) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 12:17:20 devstack cinder-volume[87317]: DEBUG cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Flow 'volume_create_manager' (d19b5714-b983-4787-afa3-b3523fbe6b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87317) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 12:17:20 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-fe0e0eff-3842-4ee5-88b8-2552558a41ad tempest-ProjectReaderTests-2041145467 None] Created volume successfully.
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Acquiring lock "cinder-055db634-1922-457d-ab7e-7e5db857a316-delete_volume" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-055db634-1922-457d-ab7e-7e5db857a316-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Acquiring lock "cinder-quobyte-055db634-1922-457d-ab7e-7e5db857a316" by "delete_volume" {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-quobyte-055db634-1922-457d-ab7e-7e5db857a316" acquired by "delete_volume" :: waited 0.016s {{(pid=87317) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b19c6-23eb-476d-afc0-574b8fc70ef7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:21 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316
Nov 05 12:17:21 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:21 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316" returned: 0 in 0.345s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:21 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316
Nov 05 12:17:21 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:21 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603/volume-055db634-1922-457d-ab7e-7e5db857a316" returned: 0 in 0.246s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-quobyte-055db634-1922-457d-ab7e-7e5db857a316" released by "delete_volume" :: held 0.637s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.quota [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Created reservations ['bd582d53-f195-4221-b476-e403ded8072c', '01e525b6-3f37-41bf-b768-e2288a91ca4f', 'fa947b23-8068-4e92-8d83-e8ef079fd070', 'fd814706-8188-4ccc-a30f-784bea049922'] {{(pid=87317) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff': None} {{(pid=87317) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8e58682d-cd9f-4f97-90e2-4022bd4a8cff'] {{(pid=87317) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.lockutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87317) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 12:17:21 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603 {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 12:17:21 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603
Nov 05 12:17:21 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 12:17:22 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Nov 05 12:17:22 devstack cinder-volume[87317]: DEBUG oslo_concurrency.processutils [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c94941971546b4a53e4fa950084ee603" returned: 0 in 0.247s {{(pid=87317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 12:17:22 devstack cinder-volume[87317]: DEBUG cinder.manager [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Notifying Schedulers of capabilities ... {{(pid=87317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 12:17:22 devstack cinder-volume[87317]: INFO cinder.volume.manager [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Deleted volume successfully.
Nov 05 12:17:22 devstack cinder-volume[87317]: DEBUG cinder.coordination [None req-9cb1b922-c281-42d4-983d-66f0a84745d6 tempest-ProjectReaderTests-2041145467 None] Lock "cinder-055db634-1922-457d-ab7e-7e5db857a316-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87317) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 12:17:31 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=12,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 12:17:32 devstack cinder-volume[87317]: DEBUG dbcounter [-] [87317] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}